00000001:02000400:3.0F:1789760455.915100:0:2964:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_hostid 00000001:02000400:3.0:1789760473.904440:0:3186:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1789760475.845471:0:3245:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 667 MB/s 00000001:01000000:0.0F:1789760476.096590:0:3245:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 561 MB/s 00000001:01000000:3.0:1789760476.347143:0:3245:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4503 MB/s 00000020:02000000:2.0F:1789760477.085110:0:3277:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_103_g082f77f 00000400:02000000:3.0:1789760478.165916:0:3292:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.112@tcp [8/256/0/180] 00008000:02000000:2.0:1789760481.540598:0:3442:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1789760523.756920:0:5251:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789760531.622879:0:5825:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789760531.622884:0:5825:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1789760531.623016:0:5825:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000af47c2e1 00000080:02000400:2.0:1789760531.623026:0:5825:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1789760531.632238:0:5825:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1789760531.632250:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789760531.632288:0:5825:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000006685a9fd) 00000020:00000080:2.0:1789760531.632309:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789760531.648038:0:5825:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789760531.648552:0:5825:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789760531.669690:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789760531.669731:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789760531.669752:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789760531.669833:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789760531.669862:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789760531.670309:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789760531.670317:0:5825:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789760531.670328:0:5825:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e099f5ef04ad861 00000020:01000004:2.0:1789760531.670334:0:5825:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789760531.670339:0:5825:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789760531.670343:0:5825:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000af47c2e1 from MGS 00000020:01000004:2.0:1789760531.670347:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789760531.670356:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000211e80b7) 00000020:00000080:2.0:1789760531.670365:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789760531.670481:0:5825:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000af47c2e1 from MGS, refs=2 00080000:01000000:2.0:1789760531.670487:0:5825:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789760531.670492:0:5825:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e099f5ef04ad86f 00000100:00100000:2.0:1789760531.670585:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789760531.670728:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789760531.670734:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789760531.671331:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789760531.671337:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789760531.672270:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789760531.672505:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789760531.672510:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789760531.673178:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789760531.673185:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789760531.673618:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789760531.673624:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789760531.674255:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760531.674259:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760531.674260:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760531.674664:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760531.674666:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760531.674667:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760531.675278:0:5825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789760531.678529:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1789760531.924966:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4131 MB/s 00000001:01000000:3.0:1789760532.174855:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3971 MB/s 00000001:01000000:3.0:1789760532.425723:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 647 MB/s 00000001:01000000:2.0:1789760532.675339:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 739 MB/s 00080000:10000000:3.0:1789760532.685075:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:2.0:1789760532.687073:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789760532.700179:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789760532.700195:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789760532.700198:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1789760532.708593:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789760532.708675:0:5825:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789760532.708725:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1789760532.709015:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789760532.709053:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789760532.709358:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789760532.709526:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789760532.709531:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789760532.714252:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789760532.714265:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789760532.714613:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789760532.714619:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789760532.715563:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789760532.715582:0:5825:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.112@tcp' 00000020:01000004:2.0:1789760532.715584:0:5825:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789760532.715632:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.112@tcp (typ=mgc) 00000020:00000080:2.0:1789760532.715643:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.112@tcp (00000000ece1c6ee) 00000020:00000080:2.0:1789760532.715657:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789760532.715739:0:5825:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000055f07742@MGC192.168.203.112@tcp: add connection 192.168.203.112@tcp at head 00010000:00010000:2.0:1789760532.715921:0:5825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.112@tcp-0 is initialized 00000040:01000000:2.0:1789760532.715927:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 1 is initialized 00000100:00080000:1.0:1789760532.718157:0:5840:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1789760532.726561:0:5842:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789760532.726601:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.112@tcp (uuid e2780560-8e82-4256-94b0-2e524f3bed06) 00000020:00000080:0.0:1789760532.726624:0:5825:0:(genops.c:1385:class_connect()) connect: client e2780560-8e82-4256-94b0-2e524f3bed06, cookie 0x3e099f5ef04ad87d 00000100:00080000:0.0:1789760532.726635:0:5825:0:(import.c:510:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789760532.726640:0:5825:0:(import.c:624:import_select_connection()) MGC192.168.203.112@tcp: import 0000000055f07742 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1789760532.726686:0:5825:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000bf49676f x1876699882979456/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789760532.726706:0:5825:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import e2780560-8e82-4256-94b0-2e524f3bed06->MGS 00000020:01000004:0.0:1789760532.726721:0:5825:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789760532.726726:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789760532.726745:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000c51473da) 00000020:00000080:0.0:1789760532.726757:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789760532.727799:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bf49676f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e2780560-8e82-4256-94b0-2e524f3bed06:3307:1876699882979456:0@lo:250: 00000100:00100000:1.0:1789760532.727910:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760532.727986:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882979456 00000100:00100000:1.0:1789760532.727994:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882979456 00000100:00100000:1.0:1789760532.728032:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789760532.728038:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005da936a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3307:x1876699882979456:12345-0@lo:250: 00010000:00080000:1.0:1789760532.728057:0:5837:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e2780560-8e82-4256-94b0-2e524f3bed06@0@lo t0 exp 0000000000000000 cur 136 last 0 00000020:00000080:1.0:1789760532.728079:0:5837:0:(genops.c:1385:class_connect()) connect: client e2780560-8e82-4256-94b0-2e524f3bed06, cookie 0x3e099f5ef04ad88b 00000100:00080000:1.0:1789760532.728197:0:5837:0:(import.c:65:import_set_state_nolock()) 000000006bf95657 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789760532.728248:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005da936a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+5:3307:x1876699882979456:12345-0@lo:250: Request processed in 209us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760532.728255:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789760532.728288:0:3307:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.112@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789760532.728295:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.112@tcp: connect to target with instance 0 00000100:00080000:1.0:1789760532.728303:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.112@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789760532.728306:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789760532.728308:0:3307:0:(import.c:65:import_set_state_nolock()) 0000000055f07742 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789760532.728311:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789760532.728318:0:3307:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789760532.728322:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bf49676f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e2780560-8e82-4256-94b0-2e524f3bed06:3307:1876699882979456:0@lo:250: 00000100:00100000:1.0:1789760532.749790:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789760532.750258:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789760532.750265:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789760532.751164:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789760532.751176:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789760532.752321:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789760532.752331:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789760532.753225:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789760532.753389:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789760532.753394:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789760532.753931:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789760532.753938:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789760532.786536:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789760532.786722:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789760532.786728:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789760532.788466:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789760532.788477:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789760532.789450:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789760532.789626:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789760532.789632:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789760532.790388:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789760532.790395:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789760532.792338:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789760532.792510:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789760532.792516:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789760532.793145:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789760532.793153:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789760532.794064:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789760532.794247:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789760532.794253:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789760532.794712:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789760532.794719:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789760532.816998:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789760532.817215:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789760532.817227:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789760532.819640:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789760532.819660:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789760532.820234:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789760532.820241:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789760532.821598:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789760532.821622:0:5825:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1789760532.821628:0:5825:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789760532.821760:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789760532.821825:0:5825:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.112@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1789760532.821829:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789760532.821831:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789760532.821832:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789760532.821833:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789760532.821834:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789760532.821835:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789760532.821836:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789760532.821838:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789760532.821839:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789760532.821840:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789760532.821841:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789760532.821842:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789760532.821845:0:5825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1789760532.821847:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789760532.821848:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789760532.821849:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789760532.821850:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789760532.821856:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789760532.821857:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789760532.821858:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789760532.821858:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789760532.821859:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789760532.821860:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789760532.821861:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789760532.821861:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789760532.821901:0:5825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789760532.821918:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000149c2584 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882979584:0@lo:253: 00000100:00100000:1.0:1789760532.821991:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760532.822056:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 0000000001a6ab49 going to sleep for 11 seconds 00000100:00100000:3.0:1789760532.822136:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882979584 00000100:00100000:3.0:1789760532.822144:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882979584 00000100:00100000:3.0:1789760532.822199:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789760532.822208:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e386befe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+5:5825:x1876699882979584:12345-0@lo:253: 20000000:01000000:3.0:1789760532.822255:0:5839:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789760532.822263:0:5839:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1789760532.823474:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789760532.823525:0:5839:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1789760532.824319:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789760532.825360:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789760532.826782:0:5839:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789760532.826787:0:5839:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789760532.826793:0:5839:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789760532.826796:0:5839:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789760532.827000:0:5839:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1789760532.827207:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789760532.827440:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1789760532.827452:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789760532.827501:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1789760532.827552:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1789760532.827593:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1789760532.827683:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1789760532.827692:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1789760532.827739:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1789760532.827747:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1789760532.827780:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1789760532.827788:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1789760532.828311:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1789760532.828365:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1789760532.828404:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789760532.828419:0:5839:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1789760532.828436:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789760532.828694:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1789760532.828704:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789760532.828753:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1789760532.828791:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1789760532.829066:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1789760532.829080:0:5839:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1789760532.829160:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1789760532.829169:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789760532.829217:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1789760532.829256:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1789760532.829288:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1789760532.829300:0:5839:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1789760532.829403:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1789760532.829412:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1789760532.829449:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1789760532.829490:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1789760532.830363:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1789760532.830426:0:5839:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789760532.830433:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1789760532.831581:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1789760532.837038:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1789760532.837069:0:5839:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.112@tcp for mdt 20000000:01000000:1.0:1789760532.837072:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:1.0:1789760532.837111:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1789760532.837119:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789760532.837156:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1789760532.837164:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:1.0:1789760532.837210:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1789760532.837219:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789760532.837253:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1789760532.837307:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1789760532.837372:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789760532.837375:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789760532.837380:0:5839:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1789760532.837385:0:5839:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1789760532.846036:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1789760532.847171:0:5839:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1789760532.864759:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1789760532.865096:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:0.0:1789760532.865173:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:0.0:1789760532.865194:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789760532.865196:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789760532.865200:0:5839:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789760532.865212:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789760532.865214:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789760532.865244:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789760532.865246:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789760532.866617:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1789760532.867263:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1789760532.867313:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1789760532.867351:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1789760532.867444:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789760532.867447:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789760532.868099:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1789760532.868599:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1789760532.868647:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1789760532.868718:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:0.0:1789760532.868735:0:5839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789760532.868737:0:5839:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1789760532.868744:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789760532.868765:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008c422ee1/0x3e099f5ef04ad892 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760532.868792:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008c422ee1/0x3e099f5ef04ad892 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760532.869016:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008c422ee1/0x3e099f5ef04ad892 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760532.869039:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008c422ee1/0x3e099f5ef04ad892 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760532.869045:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008c422ee1/0x3e099f5ef04ad892 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760532.869052:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008c422ee1/0x3e099f5ef04ad892 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760532.869057:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008c422ee1 already unused, calling callback (00000000ce7fb824) 00010000:00010000:0.0:1789760532.869060:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008c422ee1/0x3e099f5ef04ad892 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760532.869066:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008c422ee1/0x3e099f5ef04ad892 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760532.869078:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008c422ee1/0x3e099f5ef04ad892 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760532.869085:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008c422ee1/0x3e099f5ef04ad892 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760532.869090:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008c422ee1/0x3e099f5ef04ad892 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789760532.869105:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789760533.054633:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e386befe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+5:5825:x1876699882979584:12345-0@lo:253: Request processed in 232418us (232634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760533.054649:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789760533.054751:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000149c2584 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882979584:0@lo:253: 10000000:01000000:1.0:1789760533.054767:0:5825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789760533.054770:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789760533.054772:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789760533.054774:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789760533.054775:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1789760533.054776:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789760533.054778:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789760533.054779:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789760533.054780:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789760533.054782:0:5825:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789760533.054783:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789760533.054784:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789760533.054822:0:5825:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000af47c2e1 from lustre-MDT0000 10000000:01000000:1.0:1789760533.054847:0:5825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789760533.054849:0:5825:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789760533.054853:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8df2598e3370 10000000:01000000:1.0:1789760533.054857:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789760533.054864:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8df2598e3370 from 1 10000000:01000000:1.0:1789760533.054867:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789760533.054908:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000bd9b9918/0x3e099f5ef04ad899 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760533.054919:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000bd9b9918/0x3e099f5ef04ad899 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760533.054942:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000bd9b9918/0x3e099f5ef04ad899 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760533.054958:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000149c2584 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882979712:0@lo:101: 00000100:00100000:1.0:1789760533.054992:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760533.055047:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 000000002f2a2a21 going to sleep for 11 seconds 00000100:00100000:3.0:1789760533.055199:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882979712 00000100:00100000:3.0:1789760533.055206:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882979712 00000100:00100000:3.0:1789760533.055245:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789760533.055258:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e3f04e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+5:5825:x1876699882979712:12345-0@lo:101: 00010000:00010000:3.0:1789760533.055271:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760533.055284:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a2af73a2/0x3e099f5ef04ad8a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04ad899 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760533.055304:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a2af73a2/0x3e099f5ef04ad8a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04ad899 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760533.055314:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a2af73a2/0x3e099f5ef04ad8a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ad899 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760533.055321:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a2af73a2, rc 0) 00000100:00100000:3.0:1789760533.055361:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e3f04e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+6:5825:x1876699882979712:12345-0@lo:101: Request processed in 105us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760533.055367:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789760533.055482:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000149c2584 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882979712:0@lo:101: 00010000:00010000:0.0:1789760533.055494:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000bd9b9918/0x3e099f5ef04ad899 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad8a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760533.055511:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000bd9b9918/0x3e099f5ef04ad899 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04ad8a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760533.055553:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c3e221bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882979840:0@lo:501: 00000100:00100000:0.0:1789760533.055592:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760533.055612:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e98b7ea going to sleep for 11 seconds 00000100:00100000:3.0:1789760533.055664:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882979840 00000100:00100000:3.0:1789760533.055669:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882979840 00000100:00100000:3.0:1789760533.055700:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789760533.055705:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f0299e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+6:5825:x1876699882979840:12345-0@lo:501: 00000100:00100000:3.0:1789760533.056066:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f0299e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+6:5825:x1876699882979840:12345-0@lo:501: Request processed in 360us (473us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789760533.056075:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789760533.056250:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c3e221bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882979840:0@lo:501: 10000000:01000000:0.0:1789760533.056274:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789760533.056325:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000bd9b9918/0x3e099f5ef04ad899 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad8a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760533.056334:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 00000000bd9b9918/0x3e099f5ef04ad899 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad8a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760533.056344:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df2457ba800 10000000:01000000:0.0:1789760533.056348:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789760533.056352:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8df2457ba800 10000000:01000000:0.0:1789760533.056354:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789760533.056356:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8df2457ba800 from 1 10000000:01000000:0.0:1789760533.056358:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789760533.056379:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000008c422ee1/0x3e099f5ef04ad8a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760533.056385:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 000000008c422ee1/0x3e099f5ef04ad8a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760533.056392:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000008c422ee1/0x3e099f5ef04ad8a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760533.056418:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c3e221bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882979968:0@lo:101: 00000100:00100000:0.0:1789760533.056446:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760533.056479:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e98b7ea going to sleep for 11 seconds 00000100:00100000:2.0:1789760533.056542:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882979968 00000100:00100000:2.0:1789760533.056547:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882979968 00000100:00100000:2.0:1789760533.056583:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789760533.056590:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb80739e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+6:5825:x1876699882979968:12345-0@lo:101: 00010000:00010000:2.0:1789760533.056598:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760533.056608:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cca248e0/0x3e099f5ef04ad8ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04ad8a7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760533.056625:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cca248e0/0x3e099f5ef04ad8ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04ad8a7 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760533.056633:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cca248e0/0x3e099f5ef04ad8ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ad8a7 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760533.056641:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cca248e0, rc 0) 00000100:00100000:2.0:1789760533.056680:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb80739e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+7:5825:x1876699882979968:12345-0@lo:101: Request processed in 92us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760533.056686:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789760533.056799:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c3e221bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882979968:0@lo:101: 00010000:00010000:3.0:1789760533.056834:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000008c422ee1/0x3e099f5ef04ad8a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad8ae expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760533.056842:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000008c422ee1/0x3e099f5ef04ad8a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04ad8ae expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760533.056862:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789760533.057011:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000008c422ee1/0x3e099f5ef04ad8a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad8ae expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760533.057018:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 000000008c422ee1/0x3e099f5ef04ad8a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad8ae expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760533.057024:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789760533.057076:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789760533.057081:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8df2457ba800 10000000:01000000:2.0:1789760533.057085:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789760533.057088:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789760533.057089:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789760533.057195:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000e2cef995/0x3e099f5ef04ad8b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760533.057204:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000e2cef995/0x3e099f5ef04ad8b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760533.057211:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000e2cef995/0x3e099f5ef04ad8b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760533.057230:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000011af1a9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882980096:0@lo:101: 00000100:00100000:2.0:1789760533.057261:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760533.057294:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 0000000043dae034 going to sleep for 11 seconds 00000100:00100000:3.0:1789760533.057355:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882980096 00000100:00100000:3.0:1789760533.057361:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882980096 00000100:00100000:3.0:1789760533.057396:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789760533.057404:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000834371fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+7:5825:x1876699882980096:12345-0@lo:101: 00010000:00010000:3.0:1789760533.057412:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760533.057422:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000affad037/0x3e099f5ef04ad8bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04ad8b5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760533.057437:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000affad037/0x3e099f5ef04ad8bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04ad8b5 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760533.057444:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000affad037/0x3e099f5ef04ad8bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ad8b5 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760533.057452:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000affad037, rc 0) 00000100:00100000:3.0:1789760533.057561:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000834371fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+8:5825:x1876699882980096:12345-0@lo:101: Request processed in 158us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760533.057567:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789760533.057737:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000011af1a9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882980096:0@lo:101: 00010000:00010000:0.0:1789760533.057748:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000e2cef995/0x3e099f5ef04ad8b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad8bc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760533.057755:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000e2cef995/0x3e099f5ef04ad8b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04ad8bc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760533.057795:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee4e4e0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882980224:0@lo:501: 00000100:00100000:0.0:1789760533.057874:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760533.057934:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 000000002f9f1270 going to sleep for 11 seconds 00000100:00100000:3.0:1789760533.057964:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882980224 00000100:00100000:3.0:1789760533.057967:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882980224 00000100:00100000:3.0:1789760533.058026:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789760533.058032:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba76a62e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+8:5825:x1876699882980224:12345-0@lo:501: 00000100:00100000:3.0:1789760533.058285:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba76a62e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+9:5825:x1876699882980224:12345-0@lo:501: Request processed in 254us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760533.058292:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789760533.058343:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee4e4e0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882980224:0@lo:501: 00000100:00100000:0.0:1789760533.058365:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee4e4e0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882980352:0@lo:503: 00000100:00100000:0.0:1789760533.058395:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760533.058471:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 000000002f9f1270 going to sleep for 11 seconds 00000100:00100000:2.0:1789760533.058539:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882980352 00000100:00100000:2.0:1789760533.058543:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882980352 00000100:00100000:2.0:1789760533.058561:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789760533.058566:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000073b80e5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+9:5825:x1876699882980352:12345-0@lo:503: 00000100:00100000:2.0:1789760533.058692:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000073b80e5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+9:5825:x1876699882980352:12345-0@lo:503: Request processed in 126us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760533.058698:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789760533.058764:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee4e4e0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882980352:0@lo:503: 00000100:00100000:0.0:1789760533.059092:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee4e4e0f pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:5867:1876699882980480:0@lo:502: 00000100:00100000:0.0:1789760533.059183:0:5867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760533.059209:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c509b4a3 going to sleep for 11 seconds 00000100:00100000:2.0:1789760533.059250:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882980480 00000100:00100000:2.0:1789760533.059254:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882980480 00000100:00100000:2.0:1789760533.059270:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789760533.059274:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6495a7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+9:5867:x1876699882980480:12345-0@lo:502: 00000100:00100000:2.0:1789760533.059399:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6495a7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+9:5867:x1876699882980480:12345-0@lo:502: Request processed in 124us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760533.059405:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789760533.059470:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee4e4e0f pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:5867:1876699882980480:0@lo:502: 00000020:01000000:0.0:1789760533.059490:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789760533.059499:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760533.059505:0:5867:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789760533.059510:0:5867:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789760533.059513:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789760533.059524:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000456d232f) 00000020:00000080:0.0:1789760533.059538:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789760533.059542:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789760533.059603:0:5867:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789760533.059609:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e099f5ef04ad8ca 00000020:00000080:0.0:1789760533.059852:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789760533.059857:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760533.059860:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760533.059861:0:5867:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789760533.059864:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789760533.059867:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760533.059868:0:5867:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789760533.059871:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789760533.059877:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000006c618a7) 00000020:00000080:0.0:1789760533.059895:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789760533.059899:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789760533.059900:0:5867:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789760533.059902:0:5867:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789760533.059907:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789760533.059944:0:5867:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000af47c2e1 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789760533.059953:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000678f5966) 00000020:00000080:0.0:1789760533.059958:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789760533.060007:0:5867:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789760533.060011:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e099f5ef04ad8df 00000020:00000080:0.0:1789760533.060082:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789760533.060087:0:5867:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789760533.060090:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x3e099f5ef04ad8e6 00080000:01000000:0.0:1789760533.060094:0:5867:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789760533.060097:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e099f5ef04ad8ed 00080000:10000000:0.0:1789760533.060489:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1789760533.060644:0:5867:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1789760533.065004:0:5867:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1789760533.119522:0:5867:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1789760533.120032:0:5867:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1789760533.121592:0:5867:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1789760533.121786:0:5867:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789760533.145555:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000043c22705) 00000020:00000080:2.0:1789760533.145579:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789760533.145655:0:5867:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789760533.145664:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e099f5ef04ad8fb 00000020:00000080:3.0:1789760533.148344:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1789760533.153699:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789760533.185596:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789760533.208273:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789760533.228702:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789760533.259284:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789760533.287272:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1789760533.304604:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x3e099f5ef04ad902 00000020:00000080:3.0:1789760533.304967:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789760533.304977:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789760533.304983:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760533.304985:0:5867:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789760533.304988:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789760533.304994:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760533.304995:0:5867:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789760533.304999:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789760533.305033:0:5867:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789760533.305046:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789760533.305049:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760533.305050:0:5867:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789760533.305052:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789760533.305055:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760533.305056:0:5867:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789760533.305058:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789760533.305060:0:5867:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789760533.305121:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000495e3083 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:5867:1876699882980608:0@lo:502: 00000100:00100000:3.0:1789760533.305194:0:5867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760533.305246:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dcdd0872 going to sleep for 11 seconds 00000100:00100000:2.0:1789760533.305362:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882980608 00000100:00100000:2.0:1789760533.305369:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882980608 00000100:00100000:2.0:1789760533.305411:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789760533.305418:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002bb8df82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+9:5867:x1876699882980608:12345-0@lo:502: 00000100:00100000:2.0:1789760533.305757:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002bb8df82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+9:5867:x1876699882980608:12345-0@lo:502: Request processed in 338us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760533.305773:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789760533.305963:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000495e3083 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:5867:1876699882980608:0@lo:502: 00000020:01000000:3.0:1789760533.305986:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789760533.305991:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760533.305992:0:5867:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789760533.305996:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1789760533.306257:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1789760533.306274:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789760533.306295:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000e2cef995/0x3e099f5ef04ad8b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad8bc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760533.306306:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 00000000e2cef995/0x3e099f5ef04ad8b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad8bc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760533.306315:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df2457ba800 from 1 10000000:01000000:2.0:1789760533.306318:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789760533.306343:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000b3803f06/0x3e099f5ef04ad909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760533.306350:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000b3803f06/0x3e099f5ef04ad909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760533.306463:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000b3803f06/0x3e099f5ef04ad909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760533.306479:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006cfebb5b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882980736:0@lo:101: 00000100:00100000:2.0:1789760533.306512:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760533.306545:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 000000001b1b90f8 going to sleep for 11 seconds 00000100:00100000:3.0:1789760533.306596:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882980736 00000100:00100000:3.0:1789760533.306601:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882980736 00000100:00100000:3.0:1789760533.306634:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789760533.306642:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007634033f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+9:5825:x1876699882980736:12345-0@lo:101: 00010000:00010000:3.0:1789760533.306650:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760533.306663:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ef290a80/0x3e099f5ef04ad910 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04ad909 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760533.306682:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ef290a80/0x3e099f5ef04ad910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04ad909 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760533.306690:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ef290a80/0x3e099f5ef04ad910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ad909 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760533.306698:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ef290a80, rc 0) 00000100:00100000:3.0:1789760533.306735:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007634033f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+10:5825:x1876699882980736:12345-0@lo:101: Request processed in 94us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760533.306740:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789760533.306840:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006cfebb5b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882980736:0@lo:101: 00010000:00010000:0.0:1789760533.306852:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000b3803f06/0x3e099f5ef04ad909 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad910 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760533.306861:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000b3803f06/0x3e099f5ef04ad909 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04ad910 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760533.307574:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee4e4e0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882980864:0@lo:256: 00000100:00100000:0.0:1789760533.307613:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760533.307634:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000691f209d going to sleep for 11 seconds 00000100:00100000:2.0:1789760533.307702:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882980864 00000100:00100000:2.0:1789760533.307707:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882980864 00000100:00100000:2.0:1789760533.307743:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789760533.307749:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4db5078 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+10:5825:x1876699882980864:12345-0@lo:256: 20000000:01000000:2.0:1789760533.307763:0:5837:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789760533.307769:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789760533.307858:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4db5078 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+10:5825:x1876699882980864:12345-0@lo:256: Request processed in 109us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760533.307865:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789760533.308038:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee4e4e0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882980864:0@lo:256: 10000000:01000000:0.0:1789760533.308952:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789760533.308964:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000b3803f06/0x3e099f5ef04ad909 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad910 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760533.308973:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 00000000b3803f06/0x3e099f5ef04ad909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad910 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760533.308981:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df2457ba800 from 1 10000000:01000000:0.0:1789760533.308984:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789760533.309007:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000dd1290d9/0x3e099f5ef04ad917 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760533.309014:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000dd1290d9/0x3e099f5ef04ad917 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760533.309030:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000dd1290d9/0x3e099f5ef04ad917 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760533.309045:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee4e4e0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882980992:0@lo:101: 00000100:00100000:0.0:1789760533.309086:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760533.309199:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000691f209d going to sleep for 11 seconds 00000100:00100000:2.0:1789760533.309230:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882980992 00000100:00100000:2.0:1789760533.309234:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882980992 00000100:00100000:2.0:1789760533.309281:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789760533.309286:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b1efcb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+10:5825:x1876699882980992:12345-0@lo:101: 00010000:00010000:2.0:1789760533.309293:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760533.309301:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002b591b70/0x3e099f5ef04ad91e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04ad917 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760533.309314:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002b591b70/0x3e099f5ef04ad91e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04ad917 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760533.309320:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002b591b70/0x3e099f5ef04ad91e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ad917 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760533.309324:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002b591b70, rc 0) 00000100:00100000:2.0:1789760533.309351:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b1efcb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+11:5825:x1876699882980992:12345-0@lo:101: Request processed in 65us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760533.309360:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789760533.309412:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee4e4e0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882980992:0@lo:101: 00010000:00010000:0.0:1789760533.309423:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000dd1290d9/0x3e099f5ef04ad917 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad91e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760533.309430:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000dd1290d9/0x3e099f5ef04ad917 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04ad91e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760533.309471:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee4e4e0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882981120:0@lo:501: 00000100:00100000:0.0:1789760533.309500:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760533.309526:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000691f209d going to sleep for 11 seconds 00000100:00100000:2.0:1789760533.309526:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882981120 00000100:00100000:2.0:1789760533.309530:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882981120 00000100:00100000:2.0:1789760533.309552:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789760533.309557:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068243eb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+11:5825:x1876699882981120:12345-0@lo:501: 00000100:00100000:0.0:1789760533.310172:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee4e4e0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882981120:0@lo:501: 00000100:00100000:0.0:1789760533.310192:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee4e4e0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882981248:0@lo:503: 00000100:00100000:0.0:1789760533.310244:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760533.310266:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000691f209d going to sleep for 11 seconds 00000100:00100000:3.0:1789760533.310277:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882981248 00000100:00100000:3.0:1789760533.310281:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882981248 00000100:00100000:2.0:1789760533.310305:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068243eb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+12:5825:x1876699882981120:12345-0@lo:501: Request processed in 748us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760533.310309:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789760533.310322:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000149a5c86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+12:5825:x1876699882981248:12345-0@lo:503: 00000040:00080000:3.0:1789760533.310353:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789760533.310405:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000149a5c86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+12:5825:x1876699882981248:12345-0@lo:503: Request processed in 84us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760533.310430:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee4e4e0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882981248:0@lo:503: 00000100:00100000:2.0:1789760533.310517:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789760533.310599:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000040:00080000:0.0:1789760533.311176:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1789760533.311313:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789760533.311325:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789760533.311338:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000dd1290d9/0x3e099f5ef04ad917 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad91e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760533.311344:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 00000000dd1290d9/0x3e099f5ef04ad917 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad91e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760533.311377:0:5825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789760533.311379:0:5825:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df2457ba800 10000000:01000000:1.0:1789760533.311381:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df2457ba800 10000000:01000000:1.0:1789760533.311383:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789760533.311387:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df2457ba800 from 1 10000000:01000000:1.0:1789760533.311389:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789760533.311409:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000129f2140/0x3e099f5ef04ad925 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760533.311416:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000129f2140/0x3e099f5ef04ad925 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760533.311424:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000129f2140/0x3e099f5ef04ad925 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760533.311449:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e6914d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882981376:0@lo:101: 00000100:00100000:1.0:1789760533.311487:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760533.311521:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 000000008d4d358e going to sleep for 11 seconds 00000100:00100000:3.0:1789760533.311568:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882981376 00000100:00100000:3.0:1789760533.311572:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882981376 00000100:00100000:3.0:1789760533.311605:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789760533.311611:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f816cc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+11:5825:x1876699882981376:12345-0@lo:101: 00010000:00010000:3.0:1789760533.311618:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760533.311630:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000096f1774f/0x3e099f5ef04ad92c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04ad925 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760533.311646:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000096f1774f/0x3e099f5ef04ad92c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04ad925 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760533.311653:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000096f1774f/0x3e099f5ef04ad92c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ad925 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760533.311660:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000096f1774f, rc 0) 00000100:00100000:3.0:1789760533.311765:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f816cc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+12:5825:x1876699882981376:12345-0@lo:101: Request processed in 154us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760533.311771:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789760533.311947:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e6914d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882981376:0@lo:101: 00010000:00010000:1.0:1789760533.311959:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000129f2140/0x3e099f5ef04ad925 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad92c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760533.311966:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000129f2140/0x3e099f5ef04ad925 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04ad92c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760533.312003:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e6914d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882981504:0@lo:501: 00000100:00100000:1.0:1789760533.312027:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760533.312082:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 000000008d4d358e going to sleep for 11 seconds 00000100:00100000:3.0:1789760533.312186:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882981504 00000100:00100000:3.0:1789760533.312191:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882981504 00000100:00100000:3.0:1789760533.312245:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789760533.312252:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8b93756 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+12:5825:x1876699882981504:12345-0@lo:501: 00000100:00100000:3.0:1789760533.312461:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8b93756 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+12:5825:x1876699882981504:12345-0@lo:501: Request processed in 209us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760533.312473:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789760533.312533:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e6914d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882981504:0@lo:501: 00000100:00100000:1.0:1789760533.312557:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e6914d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882981632:0@lo:503: 00000100:00100000:1.0:1789760533.312591:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760533.312683:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 000000008d4d358e going to sleep for 11 seconds 00000100:00100000:2.0:1789760533.312726:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882981632 00000100:00100000:2.0:1789760533.312736:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882981632 00000100:00100000:2.0:1789760533.312765:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789760533.312771:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004dff2e99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+12:5825:x1876699882981632:12345-0@lo:503: 00000100:00100000:2.0:1789760533.313232:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004dff2e99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+12:5825:x1876699882981632:12345-0@lo:503: Request processed in 461us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760533.313239:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789760533.313520:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e6914d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882981632:0@lo:503: 00000100:00100000:3.0:1789760533.313905:0:5872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000495e3083 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:5872:1876699882981760:0@lo:502: 00000100:00100000:3.0:1789760533.313944:0:5872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760533.313971:0:5872:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c0d30bfa going to sleep for 11 seconds 00000100:00100000:0.0:1789760533.314040:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882981760 00000100:00100000:0.0:1789760533.314046:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882981760 00000100:00100000:0.0:1789760533.314082:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789760533.314089:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000064cc8e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+12:5872:x1876699882981760:12345-0@lo:502: 00000100:00100000:0.0:1789760533.314293:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000064cc8e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+12:5872:x1876699882981760:12345-0@lo:502: Request processed in 205us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760533.314300:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789760533.314349:0:5872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000495e3083 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:5872:1876699882981760:0@lo:502: 00000020:01000004:3.0:1789760533.314400:0:5872:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789760533.314424:0:5872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000097fada3e) 00000020:00000080:3.0:1789760533.314442:0:5872:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1789760533.314539:0:5872:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000af47c2e1 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789760533.314543:0:5872:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000af47c2e1 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789760533.314545:0:5872:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000af47c2e1 4 00010000:00080000:3.0:1789760533.314572:0:5872:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006eb77013@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1789760533.319580:0:5872:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1789760533.319771:0:5872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789760533.319982:0:5872:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789760533.319994:0:5872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x3e099f5ef04ad93a 00000100:00080000:3.0:1789760533.320004:0:5872:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789760533.320008:0:5872:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000006eb77013 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1789760533.320041:0:5872:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000495e3083 x1876699882981888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789760533.320163:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000495e3083 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876699882981888:0@lo:38: 00000100:00100000:1.0:1789760533.320232:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760533.320339:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882981888 00000100:00100000:2.0:1789760533.320347:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882981888 00000100:00100000:2.0:1789760533.320392:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789760533.320397:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e6914d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1876699882981888:12345-0@lo:38: 00000100:00080000:3.0:1789760533.320617:0:5872:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789760533.320780:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e6914d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1876699882981888:12345-0@lo:38: Request processed in 380us (547us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789760533.320788:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789760533.320955:0:5872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061a1691e pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:5872:1876699882982016:0@lo:502: 00000100:00100000:3.0:1789760533.321000:0:5872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760533.321023:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882982016 00000100:00100000:3.0:1789760533.321026:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882982016 00000100:00100000:3.0:1789760533.321053:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789760533.321066:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ae2ef05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+12:5872:x1876699882982016:12345-0@lo:502: 00000100:00100000:3.0:1789760533.321289:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ae2ef05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+12:5872:x1876699882982016:12345-0@lo:502: Request processed in 224us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760533.321296:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789760533.321341:0:5872:0:(client.c:2715:ptlrpc_set_wait()) set 00000000148de9fc going to sleep for 11 seconds 00000100:00100000:3.0:1789760533.321376:0:5872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061a1691e pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:5872:1876699882982016:0@lo:502: 00000040:00080000:3.0:1789760533.321399:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:1.0:1789760533.322263:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789760533.322272:0:3307:0:(import.c:65:import_set_state_nolock()) 000000006eb77013 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789760533.322277:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789760533.322280:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000495e3083 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876699882981888:0@lo:38: 00000020:01000000:1.0:1789760533.322314:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1789760533.322337:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789760533.322525:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000129f2140/0x3e099f5ef04ad925 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad92c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760533.322536:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 00000000129f2140/0x3e099f5ef04ad925 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad92c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789760533.322584:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789760533.322586:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789760533.322588:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789760533.322589:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789760533.322590:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789760533.322592:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789760533.322593:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789760533.322594:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789760533.322596:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789760533.322597:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789760533.322599:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789760533.322600:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789760533.322603:0:5825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1789760533.322606:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789760533.322607:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789760533.322608:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789760533.322609:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789760533.322610:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789760533.322611:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789760533.322612:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789760533.322613:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789760533.322614:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789760533.322615:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789760533.322616:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789760533.322617:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789760533.322636:0:5825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789760533.322647:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099aa69ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882982144:0@lo:253: 00000100:00100000:1.0:1789760533.322698:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760533.322748:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 000000002330db89 going to sleep for 11 seconds 00000100:00100000:0.0:1789760533.323209:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882982144 00000100:00100000:0.0:1789760533.323216:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882982144 00000100:00100000:0.0:1789760533.323265:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789760533.323273:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c7b50e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+12:5825:x1876699882982144:12345-0@lo:253: 20000000:01000000:0.0:1789760533.323298:0:5839:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789760533.323310:0:5839:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789760533.356254:0:5839:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789760533.356279:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1789760533.356447:0:5860:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789760533.356452:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789760533.356472:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f28fb5e6/0x3e099f5ef04ad941 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760533.356489:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ef290a80/0x3e099f5ef04ad910 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ad909 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760533.356496:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f28fb5e6/0x3e099f5ef04ad941 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760533.356532:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ef290a80/0x3e099f5ef04ad910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e099f5ef04ad909 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760533.356544:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ef290a80/0x3e099f5ef04ad910 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e099f5ef04ad909 expref: 12 pid: 5839 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760533.356557:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000022ee98d3 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1876699882982272:0@lo:104: 00000100:00100000:1.0:1789760533.356616:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760533.356668:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set 000000002f2a2a21 going to sleep for 11 seconds 00000100:00100000:0.0:1789760533.358555:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882982272 00000100:00100000:0.0:1789760533.358567:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882982272 00000100:00100000:0.0:1789760533.358609:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789760533.358617:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079cefbe3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e2780560-8e82-4256-94b0-2e524f3bed06+3:5860:x1876699882982272:12345-0@lo:104: 00010000:00010000:0.0:1789760533.358632:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: 00000000b3803f06/0x3e099f5ef04ad909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ad910 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760533.358704:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789760533.358708:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079cefbe3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e2780560-8e82-4256-94b0-2e524f3bed06+3:5860:x1876699882982272:12345-0@lo:104: Request processed in 93us (2093us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760533.358714:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789760533.358783:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789760533.358789:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 00000000b3803f06/0x3e099f5ef04ad909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ad910 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760533.358795:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b3803f06 already unused, calling callback (00000000fcf306a2) 10000000:00010000:1.0:1789760533.358798:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 00000000b3803f06/0x3e099f5ef04ad909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e099f5ef04ad910 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760533.358825:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 00000000b3803f06/0x3e099f5ef04ad909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e099f5ef04ad910 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789760533.358849:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 00000000b3803f06/0x3e099f5ef04ad909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e099f5ef04ad910 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760533.358853:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789760533.358901:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 00000000b3803f06/0x3e099f5ef04ad909 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ad910 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760533.358908:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789760533.358922:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 00000000b3803f06/0x3e099f5ef04ad909 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ad910 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760533.358927:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 00000000b3803f06/0x3e099f5ef04ad909 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ad910 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760533.358943:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760533.358945:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760533.358947:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760533.358993:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789760533.359004:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f8ff4399 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699882982400:0@lo:103: 00000100:00100000:1.0:1789760533.359039:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760533.359084:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882982400 00000100:00100000:1.0:1789760533.359088:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882982400 00010000:00010000:1.0:1789760533.359169:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ef290a80/0x3e099f5ef04ad910 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ad909 expref: 13 pid: 5839 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760533.359190:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789760533.359196:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007116963f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2780560-8e82-4256-94b0-2e524f3bed06+13:3308:x1876699882982400:12345-0@lo:103: 00010000:00010000:1.0:1789760533.359207:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760533.359210:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ef290a80/0x3e099f5ef04ad910 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ad909 expref: 13 pid: 5839 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760533.359225:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ef290a80/0x3e099f5ef04ad910 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e099f5ef04ad909 expref: 13 pid: 5839 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760533.359239:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f28fb5e6/0x3e099f5ef04ad941 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760533.359245:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f28fb5e6/0x3e099f5ef04ad941 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789760533.359257:0:5829:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002806150s 00010000:00010000:1.0:1789760533.359261:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f28fb5e6/0x3e099f5ef04ad941 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760533.359267:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f28fb5e6/0x3e099f5ef04ad941 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760533.359272:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f28fb5e6/0x3e099f5ef04ad941 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760533.359277:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f28fb5e6/0x3e099f5ef04ad941 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760533.359282:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f28fb5e6 already unused, calling callback (00000000ce7fb824) 00010000:00010000:1.0:1789760533.359285:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f28fb5e6/0x3e099f5ef04ad941 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760533.359291:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f28fb5e6/0x3e099f5ef04ad941 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760533.359298:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f28fb5e6/0x3e099f5ef04ad941 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760533.359314:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760533.359341:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007116963f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2780560-8e82-4256-94b0-2e524f3bed06+13:3308:x1876699882982400:12345-0@lo:103: Request processed in 146us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760533.359792:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789760533.359861:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f8ff4399 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699882982400:0@lo:103: 00010000:00010000:1.0:1789760533.359902:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ef290a80/0x3e099f5ef04ad910 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e099f5ef04ad909 expref: 12 pid: 5839 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760533.359913:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000022ee98d3 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1876699882982272:0@lo:104: 00010000:00010000:1.0:1789760533.359924:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f28fb5e6/0x3e099f5ef04ad941 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760533.359931:0:5860:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f28fb5e6/0x3e099f5ef04ad941 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760533.359936:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f28fb5e6/0x3e099f5ef04ad941 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760533.359941:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f28fb5e6/0x3e099f5ef04ad941 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760533.366643:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c7b50e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+11:5825:x1876699882982144:12345-0@lo:253: Request processed in 43364us (43938us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760533.366660:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789760533.366764:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099aa69ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:5825:1876699882982144:0@lo:253: 10000000:01000000:0.0:1789760533.366779:0:5825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789760533.366782:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789760533.366784:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789760533.366785:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789760533.366786:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789760533.366787:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789760533.366788:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789760533.366790:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789760533.366832:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789760533.366833:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789760533.366835:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789760533.366836:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789760533.366838:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789760533.366853:0:5825:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789760533.373547:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1789760533.375480:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789760533.375701:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1789760533.375948:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789760533.376512:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1789760533.376686:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1789760533.377478:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1789760533.377644:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1789760533.377862:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1789760533.378089:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1789760533.379413:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1789760533.379620:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1789760533.431563:0:5825:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1789760533.508587:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1789760533.509709:0:5877:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1789760533.509716:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789760533.510291:0:5878:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789760533.522399:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789760533.522763:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789760533.524332:0:5825:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789760533.524494:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789760533.524743:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789760533.525725:0:5825:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789760533.526262:0:5825:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789760533.526290:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789760533.526505:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789760533.526784:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1789760533.529110:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789760533.529310:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789760533.529530:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789760533.529702:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789760533.529962:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789760533.530123:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789760533.530266:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789760533.530912:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789760533.531057:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789760533.531219:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789760533.531452:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789760533.531604:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789760533.531971:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789760533.532124:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789760533.532268:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789760533.532522:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1789760533.533233:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1789760533.533529:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789760533.533753:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1789760533.535270:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789760533.535462:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789760533.536134:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789760533.536283:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789760533.536433:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789760533.536980:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789760533.537163:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1789760533.538327:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1789760533.538517:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1789760533.538790:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1789760533.538981:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1789760533.539384:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1789760533.539559:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1789760533.539935:0:5825:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1789760533.586835:0:5878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1789760533.673025:0:5825:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789760533.673060:0:5825:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa42d81d03988 00100000:10000000:2.0:1789760533.673068:0:5825:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789760533.675479:0:5825:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789760533.675495:0:5825:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789760533.675508:0:5825:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789760533.675528:0:5825:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1789760533.732094:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789760533.755966:0:5878:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789760533.756045:0:5878:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789760533.756049:0:5878:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1789760534.736637:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760535.759302:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760536.784680:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789760537.549250:0:6120:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789760537.810604:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789760538.706423:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789760538.706430:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789760538.706433:0:8:0:(import.c:65:import_set_state_nolock()) 000000006eb77013 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789760538.706444:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000006eb77013 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1789760538.706463:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009905cd3e x1876699882982656/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789760538.706579:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061a1691e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699882982528:0@lo:400: 00000100:00100000:3.0:1789760538.706636:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760538.706707:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009905cd3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876699882982656:0@lo:38: 00000100:00100000:3.0:1789760538.706733:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760538.706759:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882982528 00000100:00100000:3.0:1789760538.706764:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882982528 00000100:00100000:3.0:1789760538.706797:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789760538.706819:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce7d009d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+11:3310:x1876699882982528:12345-0@lo:400: 00000100:00100000:3.0:1789760538.706871:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce7d009d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+11:3310:x1876699882982528:12345-0@lo:400: Request processed in 53us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760538.706877:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789760538.706914:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061a1691e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699882982528:0@lo:400: 00000100:00100000:2.0:1789760538.709487:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882982656 00000100:00100000:2.0:1789760538.709501:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882982656 00000100:00100000:2.0:1789760538.709539:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789760538.709545:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ba52bba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1876699882982656:12345-0@lo:38: 00010000:00080000:2.0:1789760538.709572:0:5846:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 142 last 0 00000020:00000080:2.0:1789760538.709613:0:5846:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x3e099f5ef04ad948 00000004:00100000:2.0:1789760538.709653:0:5846:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789760538.709762:0:5846:0:(import.c:65:import_set_state_nolock()) 000000008a7aa0ac : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789760538.709876:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ba52bba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876699882982656:12345-0@lo:38: Request processed in 330us (3142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760538.709884:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789760538.710397:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009905cd3e x1876699882982656/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789760548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789760538.710413:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789760538.710420:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789760538.710425:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789760538.710434:0:3307:0:(import.c:65:import_set_state_nolock()) 000000006eb77013 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789760538.710440:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009905cd3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876699882982656:0@lo:38: 00010000:00010000:2.0:1789760538.831026:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760539.855754:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760540.882010:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789760541.264068:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789760541.264079:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df2457ba800 from 3 10000000:01000000:0.0:1789760541.264085:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789760541.264141:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000c4ddeb85/0x3e099f5ef04ad94f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760541.264161:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000c4ddeb85/0x3e099f5ef04ad94f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760541.264188:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000c4ddeb85/0x3e099f5ef04ad94f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760541.264217:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee4e4e0f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882982784:0@lo:101: 00000100:00100000:0.0:1789760541.264313:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760541.264392:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b3b65803 going to sleep for 11 seconds 00000100:00100000:0.0:1789760541.264424:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882982784 00000100:00100000:0.0:1789760541.264432:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882982784 00000100:00100000:0.0:1789760541.264519:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789760541.264531:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f75854f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+11:5842:x1876699882982784:12345-0@lo:101: 00010000:00010000:0.0:1789760541.264548:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760541.264565:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000aaf0cd61/0x3e099f5ef04ad956 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04ad94f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760541.264592:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aaf0cd61/0x3e099f5ef04ad956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04ad94f expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760541.264604:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000aaf0cd61/0x3e099f5ef04ad956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ad94f expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760541.264614:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000aaf0cd61, rc 0) 00000100:00100000:0.0:1789760541.264663:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f75854f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+12:5842:x1876699882982784:12345-0@lo:101: Request processed in 134us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760541.264673:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789760541.264738:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee4e4e0f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882982784:0@lo:101: 00010000:00010000:0.0:1789760541.264754:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000c4ddeb85/0x3e099f5ef04ad94f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad956 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760541.264776:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000c4ddeb85/0x3e099f5ef04ad94f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04ad956 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760541.264868:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee4e4e0f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882982912:0@lo:256: 00000100:00100000:0.0:1789760541.264906:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760541.264926:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b3b65803 going to sleep for 11 seconds 00000100:00100000:3.0:1789760541.265064:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882982912 00000100:00100000:3.0:1789760541.265078:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882982912 00000100:00100000:3.0:1789760541.265137:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789760541.265147:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd28a6a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+12:5842:x1876699882982912:12345-0@lo:256: 20000000:01000000:3.0:1789760541.265169:0:5838:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789760541.265184:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789760541.265190:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1789760541.265538:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd28a6a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+12:5842:x1876699882982912:12345-0@lo:256: Request processed in 389us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760541.265561:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee4e4e0f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882982912:0@lo:256: 10000000:01000000:0.0:1789760541.265681:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789760541.265690:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000c4ddeb85/0x3e099f5ef04ad94f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad956 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760541.265700:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 00000000c4ddeb85/0x3e099f5ef04ad94f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad956 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760541.266055:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1789760541.904548:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789760542.504696:0:6322:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdf471c340 20000000:00000080:3.0:1789760542.504712:0:6322:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df27de1ac00 uarg=0000000000000000 20000000:01000000:3.0:1789760542.504743:0:6322:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789760542.504750:0:6322:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789760542.504754:0:6322:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789760542.505317:0:6322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1789760542.505329:0:6322:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1789760542.514180:0:6322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789760542.515069:0:6322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789760542.515128:0:6322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1789760542.515174:0:6322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1789760542.515192:0:6322:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789760542.515210:0:6322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ef290a80/0x3e099f5ef04ad95d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760542.515228:0:6322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002b591b70/0x3e099f5ef04ad91e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ad917 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760542.515249:0:6322:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ef290a80/0x3e099f5ef04ad95d lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760542.515287:0:6322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002b591b70/0x3e099f5ef04ad91e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e099f5ef04ad917 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760542.515301:0:6322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002b591b70/0x3e099f5ef04ad91e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e099f5ef04ad917 expref: 11 pid: 5837 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760542.515315:0:6322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009905cd3e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6322:1876699882983040:0@lo:104: 00000100:00100000:3.0:1789760542.515374:0:6322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760542.515935:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882983040 00000100:00100000:1.0:1789760542.515946:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882983040 00000100:00100000:1.0:1789760542.516007:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789760542.516016:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061a1691e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e2780560-8e82-4256-94b0-2e524f3bed06+3:6322:x1876699882983040:12345-0@lo:104: 00010000:00010000:1.0:1789760542.516038:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: 00000000dd1290d9/0x3e099f5ef04ad917 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ad91e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760542.516085:0:6322:0:(client.c:2715:ptlrpc_set_wait()) set 000000000b72da9e going to sleep for 11 seconds 00010000:00010000:1.0:1789760542.516102:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789760542.516107:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061a1691e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e2780560-8e82-4256-94b0-2e524f3bed06+3:6322:x1876699882983040:12345-0@lo:104: Request processed in 93us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760542.516107:0:6322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009905cd3e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6322:1876699882983040:0@lo:104: 00000100:00100000:1.0:1789760542.516113:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789760542.516124:0:6322:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ef290a80/0x3e099f5ef04ad95d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760542.516134:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789760542.516138:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 00000000dd1290d9/0x3e099f5ef04ad917 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ad91e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760542.516144:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dd1290d9 already unused, calling callback (00000000fcf306a2) 10000000:00010000:1.0:1789760542.516158:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 00000000dd1290d9/0x3e099f5ef04ad917 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e099f5ef04ad91e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760542.516166:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 00000000dd1290d9/0x3e099f5ef04ad917 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e099f5ef04ad91e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789760542.516172:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 00000000dd1290d9/0x3e099f5ef04ad917 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e099f5ef04ad91e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760542.516177:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789760542.516211:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 00000000dd1290d9/0x3e099f5ef04ad917 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ad91e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760542.516230:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789760542.516248:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 00000000dd1290d9/0x3e099f5ef04ad917 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ad91e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760542.516254:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 00000000dd1290d9/0x3e099f5ef04ad917 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ad91e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760542.516269:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760542.516271:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760542.516272:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760542.516283:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000022ee98d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699882983168:0@lo:103: 00000100:00100000:1.0:1789760542.516312:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760542.516345:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882983168 00000100:00100000:1.0:1789760542.516353:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882983168 00010000:00010000:1.0:1789760542.516369:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002b591b70/0x3e099f5ef04ad91e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ad917 expref: 12 pid: 5837 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760542.516396:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789760542.516402:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8ff4399 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2780560-8e82-4256-94b0-2e524f3bed06+12:3311:x1876699882983168:12345-0@lo:103: 00010000:00010000:1.0:1789760542.516412:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760542.516416:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002b591b70/0x3e099f5ef04ad91e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ad917 expref: 12 pid: 5837 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760542.516425:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002b591b70/0x3e099f5ef04ad91e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e099f5ef04ad917 expref: 12 pid: 5837 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760542.516436:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002b591b70/0x3e099f5ef04ad91e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e099f5ef04ad917 expref: 12 pid: 5837 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760542.516459:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ef290a80/0x3e099f5ef04ad95d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760542.516466:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ef290a80/0x3e099f5ef04ad95d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760542.516477:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ef290a80/0x3e099f5ef04ad95d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760542.516483:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ef290a80/0x3e099f5ef04ad95d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760542.516488:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ef290a80/0x3e099f5ef04ad95d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760542.516493:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ef290a80/0x3e099f5ef04ad95d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760542.516497:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ef290a80 already unused, calling callback (00000000ce7fb824) 00010000:00010000:1.0:1789760542.516501:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ef290a80/0x3e099f5ef04ad95d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760542.516506:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ef290a80/0x3e099f5ef04ad95d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760542.516516:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ef290a80/0x3e099f5ef04ad95d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760542.516934:0:6322:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ef290a80/0x3e099f5ef04ad95d lrc: 2/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760542.516944:0:6322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ef290a80/0x3e099f5ef04ad95d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760542.516947:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789760542.516950:0:6322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ef290a80/0x3e099f5ef04ad95d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760542.516992:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8ff4399 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2780560-8e82-4256-94b0-2e524f3bed06+11:3311:x1876699882983168:12345-0@lo:103: Request processed in 589us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760542.517007:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789760542.517371:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000022ee98d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699882983168:0@lo:103: 00010000:00010000:0.0:1789760542.927045:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760543.823179:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001f449cc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876699882983424:0@lo:400: 00000100:00100000:2.0:1789760543.823182:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee4e4e0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699882983296:0@lo:400: 00000100:00100000:3.0:1789760543.838448:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760543.838504:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882983424 00000100:00100000:3.0:1789760543.838520:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882983424 00000100:00100000:3.0:1789760543.838571:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789760543.838580:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009905cd3e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876699882983424:12345-0@lo:400: 00000100:00100000:3.0:1789760543.838634:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009905cd3e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876699882983424:12345-0@lo:400: Request processed in 56us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760543.838641:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789760543.838708:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001f449cc0 x1876699882983424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760543.838936:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001f449cc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876699882983424:0@lo:400: 00000100:00100000:2.0:1789760543.839202:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760543.845067:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882983296 00000100:00100000:3.0:1789760543.845081:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882983296 00000100:00100000:3.0:1789760543.845135:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789760543.845143:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2eccf98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+11:3308:x1876699882983296:12345-0@lo:400: 00000100:00100000:3.0:1789760543.845236:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2eccf98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+11:3308:x1876699882983296:12345-0@lo:400: Request processed in 94us (6035us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760543.845244:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789760543.850433:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee4e4e0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699882983296:0@lo:400: 00010000:00010000:1.0:1789760543.951029:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760544.979838:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760546.001521:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760547.023943:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760548.049336:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789760548.612056:0:6690:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789760548.612060:0:6690:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1789760548.612197:0:6690:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000050183fd7 00000020:01000004:3.0:1789760548.612212:0:6690:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789760548.612223:0:6690:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789760548.612236:0:6690:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (000000004198cf19) 00000020:00000080:3.0:1789760548.612253:0:6690:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789760548.630231:0:6690:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789760548.630714:0:6690:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789760548.667214:0:6690:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789760548.676175:0:6690:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789760548.676205:0:6690:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789760548.676266:0:6690:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789760548.676294:0:6690:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789760548.678589:0:6690:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789760548.678602:0:6690:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789760548.678615:0:6690:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3e099f5ef04ad96b 00000020:01000004:2.0:1789760548.678623:0:6690:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789760548.678712:0:6690:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789760548.678716:0:6690:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789760548.678723:0:6690:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789760548.678728:0:6690:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789760548.678753:0:6690:0:(genops.c:413:class_newdev()) Allocate new device OSS (00000000632dc9ee) 00000020:00000080:2.0:1789760548.678781:0:6690:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1789760548.683893:0:6690:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789760548.684712:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789760548.684720:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789760548.699417:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789760548.699434:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789760548.703732:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789760548.703747:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789760548.705707:0:6690:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789760548.706169:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789760548.706176:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789760548.706781:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789760548.706788:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789760548.730405:0:6690:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789760548.730640:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789760548.730655:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789760548.732792:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789760548.733077:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789760548.734156:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789760548.734164:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789760548.737227:0:6690:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789760548.737437:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789760548.737443:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789760548.738210:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789760548.738218:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789760548.800352:0:6690:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789760548.800565:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789760548.800573:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789760548.803104:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789760548.803120:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789760548.805746:0:6690:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789760548.805786:0:6690:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789760548.805793:0:6690:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789760548.826086:0:6690:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789760548.826120:0:6690:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.112@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1789760548.826124:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789760548.826126:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789760548.826128:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789760548.826129:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789760548.826130:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789760548.826131:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789760548.826132:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789760548.826134:0:6690:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789760548.826135:0:6690:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789760548.826137:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789760548.826138:0:6690:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789760548.826140:0:6690:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1789760548.826142:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789760548.826143:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789760548.826144:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789760548.826145:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789760548.826146:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789760548.826147:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789760548.826148:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789760548.826149:0:6690:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789760548.826150:0:6690:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789760548.826151:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789760548.826152:0:6690:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789760548.826175:0:6690:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789760548.826192:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ca0b00a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882983552:0@lo:253: 00000100:00100000:2.0:1789760548.826275:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760548.826340:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fa42c7f9 going to sleep for 11 seconds 00000100:00100000:0.0:1789760548.826355:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882983552 00000100:00100000:0.0:1789760548.826364:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882983552 00000100:00100000:0.0:1789760548.826425:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789760548.826433:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a14b985 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+11:6690:x1876699882983552:12345-0@lo:253: 20000000:01000000:0.0:1789760548.826460:0:5838:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789760548.826464:0:5838:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1789760548.826469:0:5838:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1789760548.826472:0:5838:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1789760548.827624:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789760548.832046:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1789760548.832077:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1789760548.832147:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1789760548.832163:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1789760548.832197:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1789760548.832252:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1789760548.833028:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1789760548.833052:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.112@tcp 20000000:01000000:0.0:1789760548.833054:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:0.0:1789760548.833091:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1789760548.833099:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789760548.833145:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1789760548.833154:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:0.0:1789760548.833186:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1789760548.833196:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789760548.833222:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1789760548.833264:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1789760548.836120:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1789760548.836149:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.112@tcp 20000000:01000000:1.0:1789760548.836152:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:1.0:1789760548.836186:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1789760548.836194:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789760548.836219:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1789760548.836226:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:1.0:1789760548.836264:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1789760548.836273:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789760548.836306:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1789760548.836605:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1789760548.836628:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1789760548.836631:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1789760548.836637:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789760548.836639:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789760548.836641:0:5838:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789760548.836655:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789760548.837027:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789760548.837067:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789760548.837069:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789760548.837795:0:6705:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1789760548.837897:0:6705:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1789760548.837950:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1789760548.838624:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1789760548.838683:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1789760548.838720:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1789760548.838733:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789760548.838735:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789760548.842178:0:6706:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1789760548.842274:0:6706:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:2.0:1789760548.842343:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1789760548.842798:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1789760548.842946:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1789760548.843012:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1789760548.843026:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789760548.843028:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789760548.843683:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1789760548.844051:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1789760548.844093:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1789760548.844155:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:1.0:1789760548.845610:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789760548.845633:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003038adc0/0x3e099f5ef04ad979 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760548.845651:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a2af73a2/0x3e099f5ef04ad8a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ad899 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760548.845716:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000affad037/0x3e099f5ef04ad8bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ad8b5 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760548.845722:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000096f1774f/0x3e099f5ef04ad92c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ad925 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760548.845728:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003038adc0/0x3e099f5ef04ad979 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760548.845778:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000096f1774f/0x3e099f5ef04ad92c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e099f5ef04ad925 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760548.845862:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000096f1774f/0x3e099f5ef04ad92c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e099f5ef04ad925 expref: 11 pid: 5839 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760548.845886:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000022ee98d3 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1876699882983680:0@lo:104: 00000100:00100000:1.0:1789760548.845947:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760548.846067:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882983680 00000100:00100000:2.0:1789760548.846076:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882983680 00000100:00100000:2.0:1789760548.846121:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789760548.846128:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000669122f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e2780560-8e82-4256-94b0-2e524f3bed06+3:5838:x1876699882983680:12345-0@lo:104: 00010000:00010000:2.0:1789760548.846139:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: 00000000129f2140/0x3e099f5ef04ad925 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ad92c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760548.846185:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789760548.846190:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000669122f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e2780560-8e82-4256-94b0-2e524f3bed06+3:5838:x1876699882983680:12345-0@lo:104: Request processed in 63us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760548.846196:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789760548.848492:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760548.848503:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 00000000129f2140/0x3e099f5ef04ad925 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ad92c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760548.848515:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000129f2140 already unused, calling callback (00000000fcf306a2) 10000000:00010000:3.0:1789760548.848518:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 00000000129f2140/0x3e099f5ef04ad925 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e099f5ef04ad92c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760548.848527:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 00000000129f2140/0x3e099f5ef04ad925 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e099f5ef04ad92c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760548.848534:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 00000000129f2140/0x3e099f5ef04ad925 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e099f5ef04ad92c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760548.848539:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789760548.848625:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 00000000129f2140/0x3e099f5ef04ad925 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ad92c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760548.848648:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760548.848676:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 00000000129f2140/0x3e099f5ef04ad925 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ad92c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760548.848681:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 00000000129f2140/0x3e099f5ef04ad925 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ad92c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760548.848698:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760548.848700:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760548.848702:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760548.848721:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000022daf0a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699882983808:0@lo:103: 00000100:00100000:3.0:1789760548.848790:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789760548.849071:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000affad037/0x3e099f5ef04ad8bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e099f5ef04ad8b5 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760548.849083:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000affad037/0x3e099f5ef04ad8bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e099f5ef04ad8b5 expref: 11 pid: 5839 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760548.849093:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000201913ad pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1876699882983936:0@lo:104: 00000100:00100000:1.0:1789760548.849122:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789760548.849148:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a2af73a2/0x3e099f5ef04ad8a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e099f5ef04ad899 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760548.849155:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a2af73a2/0x3e099f5ef04ad8a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e099f5ef04ad899 expref: 11 pid: 5838 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760548.849163:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007dbbe1ab pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1876699882984064:0@lo:104: 00000100:00100000:1.0:1789760548.849183:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760548.849195:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e33d556d going to sleep for 11 seconds 00000100:00100000:1.0:1789760548.849214:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000022ee98d3 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1876699882983680:0@lo:104: 00000100:00100000:0.0:1789760548.849358:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882983936 00000100:00100000:0.0:1789760548.849364:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882983936 00000100:00100000:0.0:1789760548.849396:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882984064 00000100:00100000:0.0:1789760548.849398:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882984064 00000100:00100000:0.0:1789760548.849421:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789760548.849428:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000afe430e2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e2780560-8e82-4256-94b0-2e524f3bed06+4:5838:x1876699882983936:12345-0@lo:104: 00010000:00010000:0.0:1789760548.849437:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: 00000000e2cef995/0x3e099f5ef04ad8b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ad8bc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760548.849492:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789760548.849497:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000afe430e2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e2780560-8e82-4256-94b0-2e524f3bed06+4:5838:x1876699882983936:12345-0@lo:104: Request processed in 71us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760548.849503:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789760548.849520:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789760548.849525:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000580c1528 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e2780560-8e82-4256-94b0-2e524f3bed06+3:5838:x1876699882984064:12345-0@lo:104: 00010000:00010000:0.0:1789760548.849532:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: 00000000bd9b9918/0x3e099f5ef04ad899 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ad8a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760548.849574:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789760548.849578:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000580c1528 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e2780560-8e82-4256-94b0-2e524f3bed06+3:5838:x1876699882984064:12345-0@lo:104: Request processed in 54us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760548.849584:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789760548.849599:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789760548.849603:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 00000000e2cef995/0x3e099f5ef04ad8b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ad8bc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760548.849609:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e2cef995 already unused, calling callback (00000000fcf306a2) 10000000:00010000:0.0:1789760548.849614:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 00000000e2cef995/0x3e099f5ef04ad8b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e099f5ef04ad8bc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760548.849620:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 00000000e2cef995/0x3e099f5ef04ad8b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e099f5ef04ad8bc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760548.849625:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 00000000e2cef995/0x3e099f5ef04ad8b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e099f5ef04ad8bc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760548.849629:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789760548.849686:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000201913ad pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1876699882983936:0@lo:104: 00000100:00100000:1.0:1789760548.849694:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007dbbe1ab pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1876699882984064:0@lo:104: 00010000:00010000:1.0:1789760548.849718:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003038adc0/0x3e099f5ef04ad979 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760548.852035:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882983808 00000100:00100000:2.0:1789760548.852047:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882983808 00010000:00010000:2.0:1789760548.852087:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000096f1774f/0x3e099f5ef04ad92c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ad925 expref: 12 pid: 5839 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760548.852124:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789760548.852133:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b2a6dec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2780560-8e82-4256-94b0-2e524f3bed06+12:3310:x1876699882983808:12345-0@lo:103: 00010000:00010000:2.0:1789760548.852144:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760548.852149:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000096f1774f/0x3e099f5ef04ad92c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ad925 expref: 12 pid: 5839 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760548.852161:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000096f1774f/0x3e099f5ef04ad92c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e099f5ef04ad925 expref: 12 pid: 5839 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760548.852190:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000096f1774f/0x3e099f5ef04ad92c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e099f5ef04ad925 expref: 12 pid: 5839 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760548.852208:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760548.852264:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b2a6dec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2780560-8e82-4256-94b0-2e524f3bed06+11:3310:x1876699882983808:12345-0@lo:103: Request processed in 133us (3475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760548.852271:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789760548.852560:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000022daf0a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699882983808:0@lo:103: 00010000:00010000:0.0:1789760548.856483:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 00000000e2cef995/0x3e099f5ef04ad8b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ad8bc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760548.856501:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789760548.856570:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1789760548.857089:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 00000000e2cef995/0x3e099f5ef04ad8b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ad8bc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760548.857098:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 00000000e2cef995/0x3e099f5ef04ad8b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ad8bc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760548.857135:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789760548.857138:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 00000000bd9b9918/0x3e099f5ef04ad899 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ad8a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760548.857144:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bd9b9918 already unused, calling callback (00000000fcf306a2) 10000000:00010000:0.0:1789760548.857148:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 00000000bd9b9918/0x3e099f5ef04ad899 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e099f5ef04ad8a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760548.857156:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 00000000bd9b9918/0x3e099f5ef04ad899 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e099f5ef04ad8a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760548.857163:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 00000000bd9b9918/0x3e099f5ef04ad899 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e099f5ef04ad8a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760548.857168:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760548.857195:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 00000000bd9b9918/0x3e099f5ef04ad899 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ad8a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760548.857201:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760548.857225:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 00000000bd9b9918/0x3e099f5ef04ad899 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ad8a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760548.857232:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 00000000bd9b9918/0x3e099f5ef04ad899 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ad8a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760548.857247:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760548.857248:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760548.857250:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760548.857257:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760548.857268:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789760548.857287:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000393899cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e2780560-8e82-4256-94b0-2e524f3bed06:3309:1876699882984320:0@lo:103: 00000100:00100000:0.0:1789760548.857362:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760548.857423:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882984320 00000100:00100000:0.0:1789760548.857430:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882984320 00010000:00010000:0.0:1789760548.857455:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a2af73a2/0x3e099f5ef04ad8a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ad899 expref: 11 pid: 5838 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760548.857484:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789760548.857492:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059c64d94 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2780560-8e82-4256-94b0-2e524f3bed06+11:3309:x1876699882984320:12345-0@lo:103: 00010000:00010000:0.0:1789760548.857503:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760548.857507:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a2af73a2/0x3e099f5ef04ad8a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ad899 expref: 11 pid: 5838 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760548.857516:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a2af73a2/0x3e099f5ef04ad8a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e099f5ef04ad899 expref: 11 pid: 5838 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760548.857529:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a2af73a2/0x3e099f5ef04ad8a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e099f5ef04ad899 expref: 11 pid: 5838 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760548.857543:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760548.857577:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059c64d94 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2780560-8e82-4256-94b0-2e524f3bed06+10:3309:x1876699882984320:12345-0@lo:103: Request processed in 87us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760548.857585:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789760548.857626:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000393899cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e2780560-8e82-4256-94b0-2e524f3bed06:3309:1876699882984320:0@lo:103: 00000100:00100000:1.0:1789760548.859093:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f45e14cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699882984192:0@lo:103: 00000100:00100000:1.0:1789760548.859148:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760548.859270:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882984192 00000100:00100000:3.0:1789760548.859277:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882984192 00010000:00010000:3.0:1789760548.859300:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000affad037/0x3e099f5ef04ad8bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ad8b5 expref: 10 pid: 5839 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760548.859423:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789760548.859432:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007dbbe1ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2780560-8e82-4256-94b0-2e524f3bed06+10:3310:x1876699882984192:12345-0@lo:103: 00010000:00010000:3.0:1789760548.859444:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760548.859448:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000affad037/0x3e099f5ef04ad8bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ad8b5 expref: 10 pid: 5839 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760548.859458:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000affad037/0x3e099f5ef04ad8bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e099f5ef04ad8b5 expref: 10 pid: 5839 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760548.859472:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000affad037/0x3e099f5ef04ad8bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e099f5ef04ad8b5 expref: 10 pid: 5839 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760548.859500:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003038adc0/0x3e099f5ef04ad979 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760548.859507:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003038adc0/0x3e099f5ef04ad979 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760548.859520:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003038adc0/0x3e099f5ef04ad979 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760548.859526:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003038adc0/0x3e099f5ef04ad979 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760548.859532:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003038adc0/0x3e099f5ef04ad979 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760548.859537:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003038adc0/0x3e099f5ef04ad979 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760548.859542:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003038adc0 already unused, calling callback (00000000ce7fb824) 00010000:00010000:3.0:1789760548.859545:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003038adc0/0x3e099f5ef04ad979 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760548.859552:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003038adc0/0x3e099f5ef04ad979 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760548.859571:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003038adc0/0x3e099f5ef04ad979 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760548.859581:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760548.859623:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007dbbe1ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2780560-8e82-4256-94b0-2e524f3bed06+9:3310:x1876699882984192:12345-0@lo:103: Request processed in 193us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760548.859639:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789760548.859707:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f45e14cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699882984192:0@lo:103: 00010000:00010000:1.0:1789760548.859838:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003038adc0/0x3e099f5ef04ad979 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760548.859846:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003038adc0/0x3e099f5ef04ad979 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760548.859851:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003038adc0/0x3e099f5ef04ad979 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789760548.859865:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789760548.925885:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a14b985 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+8:6690:x1876699882983552:12345-0@lo:253: Request processed in 99445us (99602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760548.925902:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789760548.926181:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ca0b00a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882983552:0@lo:253: 10000000:01000000:2.0:1789760548.926197:0:6690:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789760548.926200:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789760548.926202:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789760548.926203:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789760548.926204:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789760548.926206:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789760548.926207:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789760548.926208:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789760548.926209:0:6690:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789760548.926211:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789760548.926212:0:6690:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789760548.926234:0:6690:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000050183fd7 from lustre-OST0000 10000000:01000000:2.0:1789760548.926259:0:6690:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789760548.926262:0:6690:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789760548.926268:0:6690:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8df2598e3370 local copy 10000000:01000000:2.0:1789760548.926271:0:6690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789760548.926305:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000b3803f06/0x3e099f5ef04ad980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760548.926316:0:6690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.112@tcp lock: 00000000b3803f06/0x3e099f5ef04ad980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760548.926343:0:6690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000b3803f06/0x3e099f5ef04ad980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760548.926361:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ca0b00a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882984448:0@lo:101: 00000100:00100000:2.0:1789760548.926400:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760548.926496:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set 0000000048732e1d going to sleep for 11 seconds 00000100:00100000:3.0:1789760548.926622:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882984448 00000100:00100000:3.0:1789760548.926629:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882984448 00000100:00100000:3.0:1789760548.928179:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789760548.928201:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e76c59e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+8:6690:x1876699882984448:12345-0@lo:101: 00010000:00010000:3.0:1789760548.928218:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760548.928236:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000affad037/0x3e099f5ef04ad987 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04ad980 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760548.928264:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000affad037/0x3e099f5ef04ad987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04ad980 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760548.928274:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000affad037/0x3e099f5ef04ad987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ad980 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760548.928283:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000affad037, rc 0) 00000100:00100000:3.0:1789760548.928356:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e76c59e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+9:6690:x1876699882984448:12345-0@lo:101: Request processed in 165us (1955us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760548.928363:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789760548.928496:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ca0b00a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882984448:0@lo:101: 00010000:00010000:2.0:1789760548.928513:0:6690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000b3803f06/0x3e099f5ef04ad980 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x3e099f5ef04ad987 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760548.928522:0:6690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000b3803f06/0x3e099f5ef04ad980 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3e099f5ef04ad987 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760548.928654:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ca0b00a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882984576:0@lo:501: 00000100:00100000:2.0:1789760548.928832:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760548.929147:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set 0000000048732e1d going to sleep for 11 seconds 00000100:00100000:0.0:1789760548.929373:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882984576 00000100:00100000:0.0:1789760548.929380:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882984576 00000100:00100000:0.0:1789760548.929411:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789760548.929418:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f3d4bd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+9:6690:x1876699882984576:12345-0@lo:501: 00000100:00100000:0.0:1789760548.929871:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f3d4bd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+9:6690:x1876699882984576:12345-0@lo:501: Request processed in 452us (1038us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789760548.929878:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789760548.931331:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ca0b00a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882984576:0@lo:501: 10000000:01000000:2.0:1789760548.931361:0:6690:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789760548.931417:0:6690:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789760548.931424:0:6690:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000b3803f06/0x3e099f5ef04ad980 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3e099f5ef04ad987 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760548.931434:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000b3803f06/0x3e099f5ef04ad980 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3e099f5ef04ad987 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760548.931441:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: 00000000b3803f06/0x3e099f5ef04ad980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3e099f5ef04ad987 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760548.931481:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789760548.931507:0:6690:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df2598cf000 10000000:01000000:2.0:1789760548.931513:0:6690:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789760548.931519:0:6690:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8df2598e3370 10000000:01000000:2.0:1789760548.931521:0:6690:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789760548.931524:0:6690:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8df2598e3370 from 1 10000000:01000000:2.0:1789760548.931528:0:6690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789760548.931560:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000c364a041/0x3e099f5ef04ad98e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760548.931568:0:6690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000c364a041/0x3e099f5ef04ad98e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760548.931577:0:6690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000c364a041/0x3e099f5ef04ad98e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760548.931596:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ca0b00a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882984704:0@lo:101: 00000100:00100000:2.0:1789760548.931651:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760548.931703:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set 000000006d7767ae going to sleep for 11 seconds 00000100:00100000:3.0:1789760548.931870:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882984704 00000100:00100000:3.0:1789760548.931878:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882984704 00000100:00100000:3.0:1789760548.931921:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789760548.931930:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f270447b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+9:6690:x1876699882984704:12345-0@lo:101: 00010000:00010000:3.0:1789760548.931943:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760548.931957:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ef290a80/0x3e099f5ef04ad995 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04ad98e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760548.932178:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ef290a80/0x3e099f5ef04ad995 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04ad98e expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760548.932188:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ef290a80/0x3e099f5ef04ad995 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ad98e expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760548.932197:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ef290a80, rc 0) 00000100:00100000:3.0:1789760548.932236:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f270447b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+10:6690:x1876699882984704:12345-0@lo:101: Request processed in 307us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760548.932242:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789760548.932340:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ca0b00a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882984704:0@lo:101: 00010000:00010000:2.0:1789760548.932352:0:6690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000c364a041/0x3e099f5ef04ad98e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad995 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760548.932360:0:6690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000c364a041/0x3e099f5ef04ad98e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04ad995 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760548.932377:0:6690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789760548.932396:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000c364a041/0x3e099f5ef04ad98e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad995 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760548.932410:0:6690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 00000000c364a041/0x3e099f5ef04ad98e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad995 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760548.932418:0:6690:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789760548.932422:0:6690:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789760548.932426:0:6690:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789760548.932429:0:6690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789760548.932445:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000e2cef995/0x3e099f5ef04ad99c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760548.932451:0:6690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000e2cef995/0x3e099f5ef04ad99c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760548.932458:0:6690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000e2cef995/0x3e099f5ef04ad99c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760548.932470:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ca0b00a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882984832:0@lo:101: 00000100:00100000:2.0:1789760548.932497:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760548.932520:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set 000000006d7767ae going to sleep for 11 seconds 00010000:00010000:0.0:1789760548.932587:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789760548.932593:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 00000000b3803f06/0x3e099f5ef04ad980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x3e099f5ef04ad987 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760548.932600:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b3803f06 already unused, calling callback (00000000fcf306a2) 10000000:00010000:0.0:1789760548.932603:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 00000000b3803f06/0x3e099f5ef04ad980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x3e099f5ef04ad987 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760548.932610:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 00000000b3803f06/0x3e099f5ef04ad980 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x3e099f5ef04ad987 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760548.932616:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 00000000b3803f06/0x3e099f5ef04ad980 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x3e099f5ef04ad987 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760548.932621:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760548.932640:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 00000000b3803f06/0x3e099f5ef04ad980 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3e099f5ef04ad987 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760548.932645:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760548.932745:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 00000000b3803f06/0x3e099f5ef04ad980 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3e099f5ef04ad987 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760548.932752:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 00000000b3803f06/0x3e099f5ef04ad980 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3e099f5ef04ad987 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760548.932763:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760548.932775:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760548.932782:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760548.932793:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882984832 00000100:00100000:0.0:1789760548.932797:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882984832 00000100:00100000:0.0:1789760548.932856:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789760548.932863:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071c951b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+10:6690:x1876699882984832:12345-0@lo:101: 00010000:00010000:0.0:1789760548.932871:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760548.932879:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dd1290d9/0x3e099f5ef04ad9a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04ad99c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760548.932892:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dd1290d9/0x3e099f5ef04ad9a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04ad99c expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760548.932900:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dd1290d9/0x3e099f5ef04ad9a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ad99c expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760548.932906:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dd1290d9, rc 0) 00000100:00100000:0.0:1789760548.932934:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071c951b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+11:6690:x1876699882984832:12345-0@lo:101: Request processed in 72us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760548.932940:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789760548.933144:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000393899cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e2780560-8e82-4256-94b0-2e524f3bed06:3309:1876699882984960:0@lo:103: 00000100:00100000:2.0:1789760548.933175:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760548.933233:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ca0b00a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882984832:0@lo:101: 00010000:00010000:2.0:1789760548.933244:0:6690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000e2cef995/0x3e099f5ef04ad99c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad9a3 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760548.933251:0:6690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000e2cef995/0x3e099f5ef04ad99c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04ad9a3 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760548.933351:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ca0b00a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882985088:0@lo:501: 00000100:00100000:2.0:1789760548.933376:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760548.933389:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set 000000006d7767ae going to sleep for 11 seconds 00000100:00100000:3.0:1789760548.933476:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882985088 00000100:00100000:3.0:1789760548.933481:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882985088 00000100:00100000:3.0:1789760548.933504:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789760548.933510:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002142cfc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+11:6690:x1876699882985088:12345-0@lo:501: 00000100:00100000:0.0:1789760548.935299:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882984960 00000100:00100000:0.0:1789760548.935314:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882984960 00000100:00100000:0.0:1789760548.935371:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789760548.935380:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062f48b50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2780560-8e82-4256-94b0-2e524f3bed06+12:3309:x1876699882984960:12345-0@lo:103: 00010000:00010000:0.0:1789760548.935393:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760548.935411:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000affad037/0x3e099f5ef04ad987 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e099f5ef04ad980 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760548.935429:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760548.935497:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062f48b50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2780560-8e82-4256-94b0-2e524f3bed06+11:3309:x1876699882984960:12345-0@lo:103: Request processed in 118us (2321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760548.935516:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789760548.935560:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000393899cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e2780560-8e82-4256-94b0-2e524f3bed06:3309:1876699882984960:0@lo:103: 00000100:00100000:3.0:1789760548.935920:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002142cfc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+10:6690:x1876699882985088:12345-0@lo:501: Request processed in 2410us (2543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760548.935929:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789760548.936133:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ca0b00a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882985088:0@lo:501: 00000100:00100000:0.0:1789760548.936173:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000393899cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882985216:0@lo:503: 00000100:00100000:0.0:1789760548.936218:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760548.936243:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set 000000005635b2be going to sleep for 11 seconds 00000100:00100000:1.0:1789760548.936395:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882985216 00000100:00100000:1.0:1789760548.936401:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882985216 00000100:00100000:1.0:1789760548.936436:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789760548.936441:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068e0c447 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+10:6690:x1876699882985216:12345-0@lo:503: 00000100:00100000:1.0:1789760548.936601:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068e0c447 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+10:6690:x1876699882985216:12345-0@lo:503: Request processed in 160us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760548.936608:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789760548.936701:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000393899cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882985216:0@lo:503: 00000040:00080000:2.0:1789760548.938738:0:6690:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789760548.938853:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008fff7565 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882985344:0@lo:502: 00000100:00100000:2.0:1789760548.938917:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760548.938942:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set 000000001b966bcd going to sleep for 11 seconds 00000100:00100000:3.0:1789760548.939117:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882985344 00000100:00100000:3.0:1789760548.939123:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882985344 00000100:00100000:3.0:1789760548.939157:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789760548.939163:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d617cfde pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+10:6690:x1876699882985344:12345-0@lo:502: 00000100:00100000:3.0:1789760548.939349:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d617cfde pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+10:6690:x1876699882985344:12345-0@lo:502: Request processed in 186us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760548.939357:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789760548.939637:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008fff7565 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882985344:0@lo:502: 00000040:00080000:2.0:1789760548.940056:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789760548.940102:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1789760548.940128:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1789760548.940176:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1789760548.940208:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1789760548.940233:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1789760548.940257:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008fff7565 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882985472:0@lo:502: 00000100:00100000:2.0:1789760548.940301:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760548.940494:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set 000000001b966bcd going to sleep for 11 seconds 00000100:00100000:3.0:1789760548.940646:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882985472 00000100:00100000:3.0:1789760548.940651:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882985472 00000100:00100000:3.0:1789760548.940784:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789760548.940817:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d539306c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+10:6690:x1876699882985472:12345-0@lo:502: 00000100:00100000:3.0:1789760548.941089:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d539306c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+10:6690:x1876699882985472:12345-0@lo:502: Request processed in 291us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760548.941097:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789760548.941184:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008fff7565 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882985472:0@lo:502: 00000040:00080000:2.0:1789760548.941277:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1789760548.941288:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1789760548.941942:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789760548.941949:0:6708:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1789760548.941956:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760548.941958:0:6708:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789760548.942072:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789760548.942094:0:6708:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (00000000636cbdcd) 00000020:00000080:2.0:1789760548.942113:0:6708:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789760548.942122:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789760548.942189:0:6708:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000050183fd7 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789760548.942196:0:6708:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789760548.942202:0:6708:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3e099f5ef04ad9b1 00000100:00100000:0.0:1789760548.942945:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789760548.942960:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d16924c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699882985600:0@lo:400: 00000100:00100000:0.0:1789760548.943043:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760548.943102:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882985600 00000100:00100000:0.0:1789760548.943108:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882985600 00000100:00100000:0.0:1789760548.943145:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789760548.943153:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3c55a84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699882985600:12345-0@lo:400: 00000100:00100000:0.0:1789760548.943199:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3c55a84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699882985600:12345-0@lo:400: Request processed in 47us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760548.943207:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789760548.943244:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d16924c3 x1876699882985600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760548.943257:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d16924c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699882985600:0@lo:400: 00010000:00010000:2.0:1789760548.950214:0:6708:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1789760548.950496:0:6708:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1789760548.962694:0:6708:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789760548.963561:0:6708:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1789760548.981396:0:6708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1789760548.982037:0:6708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1789760548.983830:0:6708:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789760548.983842:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789760548.983848:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760548.983850:0:6708:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789760548.983853:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789760548.983857:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760548.983859:0:6708:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789760548.983862:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789760548.984094:0:6708:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789760548.984167:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789760548.984171:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760548.984173:0:6708:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789760548.984176:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789760548.984325:0:6690:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1789760548.984350:0:6690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789760548.984372:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000e2cef995/0x3e099f5ef04ad99c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad9a3 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760548.984383:0:6690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 00000000e2cef995/0x3e099f5ef04ad99c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad9a3 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760548.984391:0:6690:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df2598cf000 from 1 10000000:01000000:3.0:1789760548.984393:0:6690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789760548.984426:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000b0a64689/0x3e099f5ef04ad9b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760548.984433:0:6690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000b0a64689/0x3e099f5ef04ad9b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760548.984443:0:6690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000b0a64689/0x3e099f5ef04ad9b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760548.984463:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000022daf0a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882985728:0@lo:101: 00000100:00100000:3.0:1789760548.984527:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760548.984574:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882985728 00000100:00100000:3.0:1789760548.984580:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882985728 00000100:00100000:3.0:1789760548.984623:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789760548.984631:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006099d642 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+10:6690:x1876699882985728:12345-0@lo:101: 00010000:00010000:3.0:1789760548.984644:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760548.984656:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001436f204/0x3e099f5ef04ad9bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04ad9b8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760548.984690:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001436f204/0x3e099f5ef04ad9bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04ad9b8 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760548.984699:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001436f204/0x3e099f5ef04ad9bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ad9b8 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760548.984706:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001436f204, rc 0) 00000100:00100000:3.0:1789760548.984739:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006099d642 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+11:6690:x1876699882985728:12345-0@lo:101: Request processed in 108us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760548.984745:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789760548.984832:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set 000000008884c391 going to sleep for 11 seconds 00000100:00100000:3.0:1789760548.984854:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000022daf0a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882985728:0@lo:101: 00010000:00010000:3.0:1789760548.984953:0:6690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000b0a64689/0x3e099f5ef04ad9b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad9bf expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760548.984962:0:6690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000b0a64689/0x3e099f5ef04ad9b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04ad9bf expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760548.985323:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000022daf0a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882985856:0@lo:501: 00000100:00100000:3.0:1789760548.985354:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760548.985367:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set 000000008884c391 going to sleep for 11 seconds 00000100:00100000:1.0:1789760548.987161:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882985856 00000100:00100000:1.0:1789760548.987172:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882985856 00000100:00100000:1.0:1789760548.987221:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789760548.987229:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009675de11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+11:6690:x1876699882985856:12345-0@lo:501: 00000100:00100000:1.0:1789760548.987489:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009675de11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+11:6690:x1876699882985856:12345-0@lo:501: Request processed in 261us (2135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760548.987498:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789760548.987611:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000022daf0a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882985856:0@lo:501: 00000100:00100000:3.0:1789760548.987668:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000022daf0a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882985984:0@lo:503: 00000100:00100000:3.0:1789760548.987715:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760548.987754:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set 000000008884c391 going to sleep for 11 seconds 00000100:00100000:1.0:1789760548.987890:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882985984 00000100:00100000:1.0:1789760548.987895:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882985984 00000100:00100000:1.0:1789760548.987919:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789760548.987924:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005bf7e0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+11:6690:x1876699882985984:12345-0@lo:503: 00000100:00100000:1.0:1789760548.988258:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005bf7e0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+11:6690:x1876699882985984:12345-0@lo:503: Request processed in 333us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760548.988265:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789760548.988777:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000022daf0a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882985984:0@lo:503: 00000040:00080000:3.0:1789760548.989179:0:6690:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789760548.989239:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000022daf0a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882986112:0@lo:502: 00000100:00100000:3.0:1789760548.989283:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760548.989314:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882986112 00000100:00100000:3.0:1789760548.989319:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882986112 00000100:00100000:3.0:1789760548.989349:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789760548.989357:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d6d0cfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+11:6690:x1876699882986112:12345-0@lo:502: 00000100:00100000:3.0:1789760548.989524:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d6d0cfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+11:6690:x1876699882986112:12345-0@lo:502: Request processed in 168us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760548.989531:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789760548.989578:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set 0000000086074245 going to sleep for 11 seconds 00000100:00100000:3.0:1789760548.989593:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000022daf0a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882986112:0@lo:502: 00000040:00080000:3.0:1789760548.991568:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789760548.991643:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789760548.992791:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000022daf0a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882986240:0@lo:502: 00000100:00100000:3.0:1789760548.993113:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760548.993197:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set 000000005bea821c going to sleep for 11 seconds 00000100:00100000:2.0:1789760548.993240:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882986240 00000100:00100000:2.0:1789760548.993247:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882986240 00000100:00100000:2.0:1789760548.993322:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789760548.993330:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5cbc21f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+11:6690:x1876699882986240:12345-0@lo:502: 00000100:00100000:2.0:1789760548.993577:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5cbc21f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+11:6690:x1876699882986240:12345-0@lo:502: Request processed in 248us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760548.993586:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789760548.993779:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000022daf0a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882986240:0@lo:502: 00000040:00080000:0.0:1789760548.994206:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789760548.994221:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789760548.994778:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789760548.994789:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760548.994792:0:6712:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789760548.994797:0:6712:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df2598cf000 00000020:00000080:3.0:1789760548.994940:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789760548.995057:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789760548.995061:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760548.995063:0:6712:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789760548.995066:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789760548.995265:0:6690:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789760548.995285:0:6690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789760548.995336:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241675c00/0x3e099f5ef04ad9b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad9bf expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760548.995356:0:6690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8df241675c00/0x3e099f5ef04ad9b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad9bf expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760548.995400:0:6690:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789760548.995402:0:6690:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df2598cf000 10000000:01000000:0.0:1789760548.995405:0:6690:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df2598cf000 10000000:01000000:0.0:1789760548.995409:0:6690:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789760548.995415:0:6690:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df2598cf000 from 1 10000000:01000000:0.0:1789760548.995417:0:6690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789760548.995448:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df243a67200/0x3e099f5ef04ad9c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760548.995456:0:6690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8df243a67200/0x3e099f5ef04ad9c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760548.995467:0:6690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8df243a67200/0x3e099f5ef04ad9c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760548.995487:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25855a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882986368:0@lo:101: 00000100:00100000:0.0:1789760548.995539:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760548.995581:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df247978e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789760548.995639:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882986368 00000100:00100000:2.0:1789760548.995646:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882986368 00000100:00100000:2.0:1789760548.995703:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789760548.995712:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+11:6690:x1876699882986368:12345-0@lo:101: 00010000:00010000:2.0:1789760548.995725:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760548.995737:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241539600/0x3e099f5ef04ad9cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04ad9c6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760548.995760:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241539600/0x3e099f5ef04ad9cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04ad9c6 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760548.995781:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241539600/0x3e099f5ef04ad9cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ad9c6 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760548.995788:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241539600, rc 0) 00000100:00100000:2.0:1789760548.995890:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+12:6690:x1876699882986368:12345-0@lo:101: Request processed in 179us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760548.995897:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789760548.996166:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25855a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882986368:0@lo:101: 00010000:00010000:0.0:1789760548.996181:0:6690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8df243a67200/0x3e099f5ef04ad9c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad9cd expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760548.996190:0:6690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8df243a67200/0x3e099f5ef04ad9c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04ad9cd expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760548.996280:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25855a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882986496:0@lo:501: 00000100:00100000:0.0:1789760548.996307:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760548.996338:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df247978e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789760548.996389:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882986496 00000100:00100000:2.0:1789760548.996395:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882986496 00000100:00100000:2.0:1789760548.996426:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789760548.996433:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+12:6690:x1876699882986496:12345-0@lo:501: 00000100:00100000:2.0:1789760548.996619:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+12:6690:x1876699882986496:12345-0@lo:501: Request processed in 185us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760548.996626:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789760548.996696:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25855a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882986496:0@lo:501: 00000100:00100000:0.0:1789760548.996719:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25855a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882986624:0@lo:503: 00000100:00100000:0.0:1789760548.996753:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760548.996780:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df247978e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789760548.996793:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882986624 00000100:00100000:0.0:1789760548.996796:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882986624 00000100:00100000:0.0:1789760548.996841:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789760548.996846:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+12:6690:x1876699882986624:12345-0@lo:503: 00000100:00100000:0.0:1789760548.996980:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+12:6690:x1876699882986624:12345-0@lo:503: Request processed in 133us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760548.997149:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789760548.997187:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25855a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882986624:0@lo:503: 00000040:00080000:0.0:1789760548.997441:0:6690:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789760548.997495:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25855a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882986752:0@lo:502: 00000100:00100000:0.0:1789760548.997532:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760548.997556:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882986752 00000100:00100000:0.0:1789760548.997560:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882986752 00000100:00100000:0.0:1789760548.997577:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789760548.997584:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+12:6690:x1876699882986752:12345-0@lo:502: 00000100:00100000:0.0:1789760548.997835:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+12:6690:x1876699882986752:12345-0@lo:502: Request processed in 250us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760548.997849:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789760548.997950:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df247978e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789760548.997966:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25855a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882986752:0@lo:502: 00000040:00080000:0.0:1789760548.998225:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789760548.998268:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789760548.998303:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789760548.998347:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789760548.998383:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789760548.998448:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789760548.998488:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789760548.998518:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789760548.998566:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789760548.998603:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789760548.998637:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789760548.999104:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789760548.999144:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789760548.999179:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789760548.999219:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789760548.999247:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789760548.999277:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789760548.999328:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789760548.999366:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789760548.999402:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789760548.999466:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789760548.999504:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789760548.999537:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789760548.999586:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789760548.999624:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1789760548.999737:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1789760549.000303:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1789760549.000349:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1789760549.000398:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25855a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882986880:0@lo:502: 00000100:00100000:0.0:1789760549.000465:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760549.000543:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df261c89240 going to sleep for 11 seconds 00000100:00100000:0.0:1789760549.000566:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882986880 00000100:00100000:0.0:1789760549.000572:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882986880 00000100:00100000:2.0:1789760549.000631:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789760549.000641:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247857c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+12:6690:x1876699882986880:12345-0@lo:502: 00000100:00100000:2.0:1789760549.001191:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247857c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+12:6690:x1876699882986880:12345-0@lo:502: Request processed in 550us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760549.001200:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789760549.001351:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25855a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882986880:0@lo:502: 00000040:00080000:3.0:1789760549.001435:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1789760549.001450:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789760549.002406:0:6713:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789760549.002485:0:6713:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8df1410c0000) 00000020:00000080:0.0:1789760549.002505:0:6713:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1789760549.002595:0:6713:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df2598cf000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789760549.002599:0:6713:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df2598cf000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789760549.002602:0:6713:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df2598cf000 3 00010000:00080000:0.0:1789760549.002630:0:6713:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df1410cd800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1789760549.005927:0:6713:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1789760549.006181:0:6713:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789760549.006219:0:6713:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789760549.006231:0:6713:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x3e099f5ef04ad9db 00000100:00080000:1.0:1789760549.006241:0:6713:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789760549.006247:0:6713:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8df1410cd800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1789760549.006416:0:6713:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df27c652a00 x1876699882987008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789760549.006442:0:6713:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789760549.006541:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c652a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1876699882987008:0@lo:38: 00000100:00100000:3.0:1789760549.006609:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760549.006956:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882987008 00000100:00100000:1.0:1789760549.006968:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882987008 00000100:00100000:1.0:1789760549.007093:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789760549.007100:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1876699882987008:12345-0@lo:38: 00010000:00080000:1.0:1789760549.007121:0:5846:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 153 last 0 00000020:00000080:1.0:1789760549.007146:0:5846:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x3e099f5ef04ad9e2 00000004:00100000:1.0:1789760549.007159:0:5846:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789760549.007183:0:5846:0:(import.c:65:import_set_state_nolock()) ffff8df26cd8a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789760549.007238:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876699882987008:12345-0@lo:38: Request processed in 137us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760549.007245:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789760549.007345:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8df27c652a00 x1876699882987008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789760559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760549.007354:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789760549.007361:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789760549.007367:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789760549.007371:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789760549.007374:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8df1410cd800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789760549.007379:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c652a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1876699882987008:0@lo:38: 00000040:00080000:3.0:1789760549.012266:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1789760549.012398:0:6690:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1789760549.012424:0:6690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789760549.012446:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df243a67200/0x3e099f5ef04ad9c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad9cd expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760549.012458:0:6690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8df243a67200/0x3e099f5ef04ad9c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad9cd expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789760549.012513:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789760549.012515:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789760549.012517:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789760549.012518:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789760549.012519:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789760549.012521:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789760549.012522:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789760549.012524:0:6690:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789760549.012525:0:6690:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789760549.012527:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789760549.012528:0:6690:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789760549.012532:0:6690:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1789760549.012534:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789760549.012535:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789760549.012543:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789760549.012544:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789760549.012545:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789760549.012546:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789760549.012547:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789760549.012548:0:6690:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789760549.012549:0:6690:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789760549.012549:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789760549.012550:0:6690:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789760549.012579:0:6690:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789760549.012599:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c651180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882987136:0@lo:253: 00000100:00100000:1.0:1789760549.012679:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760549.012729:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df258e7d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789760549.013114:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882987136 00000100:00100000:2.0:1789760549.013122:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882987136 00000100:00100000:2.0:1789760549.013209:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789760549.013220:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247856450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+12:6690:x1876699882987136:12345-0@lo:253: 20000000:01000000:2.0:1789760549.013245:0:5837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789760549.013259:0:5837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789760549.034221:0:5837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789760549.034238:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789760549.034274:0:5860:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789760549.034278:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789760549.034299:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df243a67a00/0x3e099f5ef04ad9e9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760549.034437:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df243a66c00/0x3e099f5ef04ad956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ad94f expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760549.034447:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df243a67a00/0x3e099f5ef04ad9e9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760549.034495:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df243a66c00/0x3e099f5ef04ad956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e099f5ef04ad94f expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760549.034510:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df243a66c00/0x3e099f5ef04ad956 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e099f5ef04ad94f expref: 12 pid: 5839 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760549.034534:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25855ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1876699882987264:0@lo:104: 00000100:00100000:0.0:1789760549.034612:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760549.034690:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df253504b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789760549.034969:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882987264 00000100:00100000:2.0:1789760549.034978:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882987264 00000100:00100000:2.0:1789760549.035028:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789760549.035037:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258558000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e2780560-8e82-4256-94b0-2e524f3bed06+3:5860:x1876699882987264:12345-0@lo:104: 00010000:00010000:2.0:1789760549.035050:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8df243a66800/0x3e099f5ef04ad94f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ad956 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760549.035120:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789760549.035127:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258558000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e2780560-8e82-4256-94b0-2e524f3bed06+3:5860:x1876699882987264:12345-0@lo:104: Request processed in 91us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760549.035134:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789760549.035157:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25855ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1876699882987264:0@lo:104: 00010000:00010000:1.0:1789760549.035176:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df243a67a00/0x3e099f5ef04ad9e9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760549.035849:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789760549.035858:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8df243a66800/0x3e099f5ef04ad94f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ad956 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760549.035876:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66800 already unused, calling callback (ffffffffc1be8c20) 10000000:00010000:2.0:1789760549.035881:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8df243a66800/0x3e099f5ef04ad94f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e099f5ef04ad956 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760549.035890:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8df243a66800/0x3e099f5ef04ad94f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e099f5ef04ad956 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789760549.035898:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8df243a66800/0x3e099f5ef04ad94f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e099f5ef04ad956 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760549.035904:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789760549.035940:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8df243a66800/0x3e099f5ef04ad94f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ad956 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760549.035947:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789760549.035972:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8df243a66800/0x3e099f5ef04ad94f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ad956 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760549.035979:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8df243a66800/0x3e099f5ef04ad94f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ad956 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760549.036007:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760549.036009:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760549.036011:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760549.036122:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699882987392:0@lo:103: 00000100:00100000:1.0:1789760549.036170:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760549.036199:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882987392 00000100:00100000:3.0:1789760549.036206:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882987392 00010000:00010000:3.0:1789760549.036228:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df243a66c00/0x3e099f5ef04ad956 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ad94f expref: 13 pid: 5839 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760549.036282:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789760549.036290:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df260393450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2780560-8e82-4256-94b0-2e524f3bed06+13:3311:x1876699882987392:12345-0@lo:103: 00010000:00010000:3.0:1789760549.036300:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760549.036305:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df243a66c00/0x3e099f5ef04ad956 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ad94f expref: 13 pid: 5839 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760549.036327:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df243a66c00/0x3e099f5ef04ad956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e099f5ef04ad94f expref: 13 pid: 5839 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760549.036341:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df243a66c00/0x3e099f5ef04ad956 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e099f5ef04ad94f expref: 13 pid: 5839 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760549.036355:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df243a67a00/0x3e099f5ef04ad9e9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760549.036363:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df243a67a00/0x3e099f5ef04ad9e9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789760549.036378:0:5830:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002806150s 00010000:00010000:3.0:1789760549.036383:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df243a67a00/0x3e099f5ef04ad9e9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760549.036390:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df243a67a00/0x3e099f5ef04ad9e9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760549.036397:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df243a67a00/0x3e099f5ef04ad9e9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760549.036403:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df243a67a00/0x3e099f5ef04ad9e9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760549.036408:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760549.036423:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df243a67a00/0x3e099f5ef04ad9e9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760549.036431:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df243a67a00/0x3e099f5ef04ad9e9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760549.036460:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df243a67a00/0x3e099f5ef04ad9e9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760549.036469:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760549.036503:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df260393450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2780560-8e82-4256-94b0-2e524f3bed06+12:3311:x1876699882987392:12345-0@lo:103: Request processed in 214us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760549.036510:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789760549.036518:0:5860:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df243a67a00/0x3e099f5ef04ad9e9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760549.036532:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df243a67a00/0x3e099f5ef04ad9e9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760549.036538:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df243a67a00/0x3e099f5ef04ad9e9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760549.037176:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699882987392:0@lo:103: 00000100:00100000:0.0:1789760549.043649:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247856450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+11:6690:x1876699882987136:12345-0@lo:253: Request processed in 30421us (30960us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760549.043663:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789760549.043746:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c651180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:6690:1876699882987136:0@lo:253: 10000000:01000000:1.0:1789760549.043760:0:6690:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789760549.043773:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789760549.043775:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789760549.043790:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789760549.043791:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789760549.043792:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789760549.043794:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789760549.043795:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789760549.043797:0:6690:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789760549.043798:0:6690:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789760549.043951:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789760549.043953:0:6690:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789760549.043969:0:6690:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789760549.052921:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789760549.053101:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789760549.053343:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789760549.055815:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789760549.056257:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789760549.056540:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789760549.063033:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1789760549.070891:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1789760549.275174:0:6690:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789760549.275181:0:6690:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789760549.275214:0:6690:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789760549.275267:0:6690:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789760549.275281:0:6690:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789760549.275306:0:6690:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 10000000:01000000:3.0:1789760549.903892:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789760549.903900:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df2457ba800 from 21 10000000:01000000:3.0:1789760549.903906:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789760549.903957:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241674200/0x3e099f5ef04ad9f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760549.903970:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8df241674200/0x3e099f5ef04ad9f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760549.903995:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8df241674200/0x3e099f5ef04ad9f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760549.904021:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cd8d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882987520:0@lo:101: 00000100:00100000:3.0:1789760549.904102:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760549.904195:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df24f308780 going to sleep for 11 seconds 00000100:00100000:2.0:1789760549.904435:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882987520 00000100:00100000:2.0:1789760549.904444:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882987520 00000100:00100000:2.0:1789760549.904492:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789760549.904501:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247854850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+11:5842:x1876699882987520:12345-0@lo:101: 00010000:00010000:2.0:1789760549.904514:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760549.904527:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241539c00/0x3e099f5ef04ad9f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04ad9f0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760549.904551:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241539c00/0x3e099f5ef04ad9f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04ad9f0 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760549.904562:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241539c00/0x3e099f5ef04ad9f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ad9f0 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760549.904572:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241539c00, rc 0) 00000100:00100000:2.0:1789760549.904618:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247854850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+12:5842:x1876699882987520:12345-0@lo:101: Request processed in 118us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760549.904625:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789760549.904743:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cd8d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882987520:0@lo:101: 00010000:00010000:3.0:1789760549.904757:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8df241674200/0x3e099f5ef04ad9f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad9f7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760549.904777:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8df241674200/0x3e099f5ef04ad9f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04ad9f7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760549.904870:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cd8d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882987648:0@lo:501: 00000100:00100000:3.0:1789760549.904896:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760549.904920:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df24f308780 going to sleep for 11 seconds 00000100:00100000:1.0:1789760549.905097:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882987648 00000100:00100000:1.0:1789760549.905102:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882987648 00000100:00100000:1.0:1789760549.905126:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789760549.905134:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247856c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+12:5842:x1876699882987648:12345-0@lo:501: 00000100:00100000:1.0:1789760549.905406:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247856c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+12:5842:x1876699882987648:12345-0@lo:501: Request processed in 272us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760549.905414:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789760549.905577:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cd8d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882987648:0@lo:501: 00000100:00100000:3.0:1789760549.905608:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cd8d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882987776:0@lo:503: 00000100:00100000:3.0:1789760549.905647:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760549.905677:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df24f308780 going to sleep for 11 seconds 00000100:00100000:2.0:1789760549.905735:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882987776 00000100:00100000:2.0:1789760549.905740:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882987776 00000100:00100000:2.0:1789760549.905778:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789760549.905785:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247857050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+12:5842:x1876699882987776:12345-0@lo:503: 00000100:00100000:2.0:1789760549.905954:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247857050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+12:5842:x1876699882987776:12345-0@lo:503: Request processed in 169us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760549.905971:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789760549.906135:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cd8d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882987776:0@lo:503: 00000100:00100000:3.0:1789760549.906560:0:6749:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cd8d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:6749:1876699882987904:0@lo:502: 00000100:00100000:3.0:1789760549.906599:0:6749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760549.906629:0:6749:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df24f3086c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789760549.906678:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882987904 00000100:00100000:0.0:1789760549.906683:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882987904 00000100:00100000:0.0:1789760549.906706:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789760549.906712:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247855450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+13:6749:x1876699882987904:12345-0@lo:502: 00000100:00100000:0.0:1789760549.906924:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247855450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+13:6749:x1876699882987904:12345-0@lo:502: Request processed in 211us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760549.906930:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789760549.907198:0:6749:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cd8d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:6749:1876699882987904:0@lo:502: 00000100:00100000:3.0:1789760549.907252:0:6749:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cd8d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:6749:1876699882988032:0@lo:502: 00000100:00100000:3.0:1789760549.907285:0:6749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760549.907315:0:6749:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df24f3086c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789760549.907421:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882988032 00000100:00100000:0.0:1789760549.907425:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882988032 00000100:00100000:0.0:1789760549.907464:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789760549.907471:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247857850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+12:6749:x1876699882988032:12345-0@lo:502: 00000100:00100000:0.0:1789760549.907619:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247857850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+12:6749:x1876699882988032:12345-0@lo:502: Request processed in 148us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760549.907625:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789760549.907794:0:6749:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cd8d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:6749:1876699882988032:0@lo:502: 00000040:00080000:3.0:1789760549.907863:0:6749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1789760549.908013:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1789760549.908028:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789760549.908038:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241674200/0x3e099f5ef04ad9f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad9f7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760549.908053:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8df241674200/0x3e099f5ef04ad9f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ad9f7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760549.908061:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789760549.908064:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df2457ba800 from 4 10000000:01000000:0.0:1789760549.908067:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789760549.908092:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df243a67800/0x3e099f5ef04ad9fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760549.908099:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8df243a67800/0x3e099f5ef04ad9fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760549.908107:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8df243a67800/0x3e099f5ef04ad9fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760549.908119:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25855b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882988160:0@lo:101: 00000100:00100000:0.0:1789760549.908144:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760549.908526:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df2686c9300 going to sleep for 11 seconds 00000100:00100000:3.0:1789760549.911730:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882988160 00000100:00100000:3.0:1789760549.911743:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882988160 00000100:00100000:3.0:1789760549.911819:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789760549.911829:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247854c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+12:5842:x1876699882988160:12345-0@lo:101: 00010000:00010000:3.0:1789760549.911843:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760549.911861:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241674600/0x3e099f5ef04ada05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04ad9fe expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760549.911886:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241674600/0x3e099f5ef04ada05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04ad9fe expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760549.911897:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241674600/0x3e099f5ef04ada05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ad9fe expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760549.911905:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241674600, rc 0) 00000100:00100000:3.0:1789760549.912103:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247854c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+13:5842:x1876699882988160:12345-0@lo:101: Request processed in 275us (3957us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760549.912110:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789760549.912336:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25855b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882988160:0@lo:101: 00010000:00010000:0.0:1789760549.912352:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8df243a67800/0x3e099f5ef04ad9fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ada05 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760549.912361:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8df243a67800/0x3e099f5ef04ad9fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04ada05 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760549.912431:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25855b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882988288:0@lo:256: 00000100:00100000:0.0:1789760549.912465:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760549.912505:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df2686c9300 going to sleep for 11 seconds 00000100:00100000:3.0:1789760549.912618:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882988288 00000100:00100000:3.0:1789760549.912623:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882988288 00000100:00100000:3.0:1789760549.912649:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789760549.912655:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247855050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+13:5842:x1876699882988288:12345-0@lo:256: 20000000:01000000:3.0:1789760549.912667:0:5839:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789760549.912681:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789760549.912684:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1789760549.912749:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247855050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+13:5842:x1876699882988288:12345-0@lo:256: Request processed in 93us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760549.912755:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789760549.912937:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25855b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882988288:0@lo:256: 10000000:01000000:0.0:1789760549.913033:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789760549.913041:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df243a67800/0x3e099f5ef04ad9fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ada05 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760549.913050:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8df243a67800/0x3e099f5ef04ad9fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ada05 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760549.913059:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789760549.913062:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1789760549.913064:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789760549.913081:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df243a66200/0x3e099f5ef04ada0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760549.913089:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8df243a66200/0x3e099f5ef04ada0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760549.913097:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8df243a66200/0x3e099f5ef04ada0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760549.913107:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25855b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882988416:0@lo:101: 00000100:00100000:0.0:1789760549.913129:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760549.913152:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df2686c9300 going to sleep for 11 seconds 00000100:00100000:3.0:1789760549.913244:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882988416 00000100:00100000:3.0:1789760549.913253:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882988416 00000100:00100000:3.0:1789760549.913279:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789760549.913284:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247857450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+13:5842:x1876699882988416:12345-0@lo:101: 00010000:00010000:3.0:1789760549.913292:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760549.913299:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241675a00/0x3e099f5ef04ada13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04ada0c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760549.913313:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241675a00/0x3e099f5ef04ada13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04ada0c expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760549.913322:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241675a00/0x3e099f5ef04ada13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ada0c expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760549.913329:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241675a00, rc 0) 00000100:00100000:3.0:1789760549.913359:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247857450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+14:5842:x1876699882988416:12345-0@lo:101: Request processed in 75us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760549.913364:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789760549.913436:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25855b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882988416:0@lo:101: 00010000:00010000:0.0:1789760549.913447:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8df243a66200/0x3e099f5ef04ada0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ada13 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760549.913454:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8df243a66200/0x3e099f5ef04ada0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04ada13 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760549.913499:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25855b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882988544:0@lo:501: 00000100:00100000:0.0:1789760549.913519:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760549.913535:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df2686c9300 going to sleep for 11 seconds 00000100:00100000:3.0:1789760549.913654:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882988544 00000100:00100000:3.0:1789760549.913658:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882988544 00000100:00100000:3.0:1789760549.913706:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789760549.913712:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247855850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+14:5842:x1876699882988544:12345-0@lo:501: 00000100:00100000:3.0:1789760549.913972:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247855850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+14:5842:x1876699882988544:12345-0@lo:501: Request processed in 258us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760549.914127:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789760549.914206:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25855b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882988544:0@lo:501: 00000100:00100000:0.0:1789760549.914231:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25855b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882988672:0@lo:503: 00000100:00100000:0.0:1789760549.914267:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760549.914297:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df2686c9300 going to sleep for 11 seconds 00000100:00100000:3.0:1789760549.914381:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882988672 00000100:00100000:3.0:1789760549.914386:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882988672 00000100:00100000:3.0:1789760549.914403:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789760549.914409:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247854450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+14:5842:x1876699882988672:12345-0@lo:503: 00000100:00100000:3.0:1789760549.914586:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247854450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+14:5842:x1876699882988672:12345-0@lo:503: Request processed in 177us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760549.914598:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789760549.914952:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25855b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882988672:0@lo:503: 00000100:00100000:0.0:1789760549.915391:0:6750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25855b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:6750:1876699882988800:0@lo:502: 00000100:00100000:0.0:1789760549.915428:0:6750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760549.915461:0:6750:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df2686c9600 going to sleep for 11 seconds 00000100:00100000:3.0:1789760549.915519:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882988800 00000100:00100000:3.0:1789760549.915524:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882988800 00000100:00100000:3.0:1789760549.915545:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789760549.915553:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247856050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+14:6750:x1876699882988800:12345-0@lo:502: 00000100:00100000:3.0:1789760549.915858:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247856050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+14:6750:x1876699882988800:12345-0@lo:502: Request processed in 204us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760549.915867:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789760549.916067:0:6750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25855b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:6750:1876699882988800:0@lo:502: 00000020:01000000:0.0:1789760549.916089:0:6750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789760549.916097:0:6750:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789760549.916104:0:6750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760549.916106:0:6750:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789760549.916111:0:6750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789760549.916114:0:6750:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:0.0:1789760549.916135:0:6750:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789760549.916138:0:6750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789760549.916153:0:6750:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8df1410c3370) 00000020:00000080:0.0:1789760549.916173:0:6750:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1789760549.916182:0:6750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789760549.916635:0:6750:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789760549.916641:0:6750:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789760549.916654:0:6750:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e099f5ef04ada21 00010000:00080000:0.0:1789760549.916687:0:6750:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df2578da000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:0.0:1789760549.917671:0:6750:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1789760550.057451:0:6750:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789760550.057475:0:6750:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789760550.058131:0:6750:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789760550.058629:0:6750:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789760550.058678:0:6750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789760550.058736:0:6750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789760550.063394:0:6759:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789760550.063401:0:6759:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789760550.067241:0:6750:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789760550.067258:0:6750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789760550.067296:0:6750:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789760550.067318:0:6750:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e099f5ef04ada28 00000100:00080000:1.0:1789760550.067327:0:6750:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789760550.067332:0:6750:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8df2578da000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1789760550.067366:0:6750:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df27c651180 x1876699882988928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789760550.067391:0:6750:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789760550.067451:0:6750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789760550.067456:0:6750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760550.067458:0:6750:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789760550.067461:0:6750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789760550.067464:0:6750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760550.067465:0:6750:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789760550.067473:0:6750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789760550.067475:0:6750:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789760550.067501:0:6750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c652680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:6750:1876699882989056:0@lo:502: 00000100:00100000:1.0:1789760550.067571:0:6750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760550.067615:0:6750:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df260088180 going to sleep for 11 seconds 00000100:00100000:1.0:1789760550.067636:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1876699882988928:0@lo:8: 00000100:00100000:1.0:1789760550.067663:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760550.067929:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882989056 00000100:00100000:1.0:1789760550.067936:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882989056 00000100:00100000:1.0:1789760550.068261:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789760550.068271:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247856850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+14:6750:x1876699882989056:12345-0@lo:502: 00000100:00100000:0.0:1789760550.071185:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c650000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1876699882989312:0@lo:400: 00000100:00100000:0.0:1789760550.071283:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760550.071334:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789760550.071342:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876699882989184:0@lo:400: 00000100:00100000:0.0:1789760550.071365:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760550.071410:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882989312 00000100:00100000:0.0:1789760550.071417:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882989312 00000100:00100000:0.0:1789760550.071462:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882989184 00000100:00100000:0.0:1789760550.071465:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882989184 00000100:00100000:0.0:1789760550.071480:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789760550.071487:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25855b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876699882989312:12345-0@lo:400: 00000100:00100000:0.0:1789760550.071534:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25855b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876699882989312:12345-0@lo:400: Request processed in 48us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760550.071540:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789760550.071557:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789760550.071562:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25855bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876699882989184:12345-0@lo:400: 00000100:00100000:0.0:1789760550.071585:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25855bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876699882989184:12345-0@lo:400: Request processed in 23us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760550.071591:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789760550.071606:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789760550.071639:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27c652d80 x1876699882989184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760550.071653:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876699882989184:0@lo:400: 00010000:00080000:0.0:1789760550.071664:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27c650000 x1876699882989312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760550.071672:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c650000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1876699882989312:0@lo:400: 00000100:00100000:2.0:1789760550.072884:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882988928 00000100:00100000:2.0:1789760550.072893:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882988928 00000100:00100000:2.0:1789760550.072930:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789760550.072936:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c651880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1876699882988928:12345-0@lo:8: 00010000:00080000:2.0:1789760550.072961:0:6693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:2.0:1789760550.072996:0:6693:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e099f5ef04ada2f 00002000:00100000:2.0:1789760550.073036:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8df141195000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789760550.073040:0:6693:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1789760550.073045:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789760550.073156:0:6693:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789760550.073299:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789760550.073322:0:6693:0:(import.c:65:import_set_state_nolock()) ffff8df141193800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789760550.073387:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c651880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1876699882988928:12345-0@lo:8: Request processed in 450us (5722us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760550.073394:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789760550.076996:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247856850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+14:6750:x1876699882989056:12345-0@lo:502: Request processed in 8706us (9404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760550.077011:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1789760550.077112:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27c651180 x1876699882988928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789760560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760550.077125:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789760550.077135:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789760550.077143:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789760550.077148:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789760550.077152:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8df2578da000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789760550.077165:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789760550.077171:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1876699882988928:0@lo:8: 00000100:00100000:1.0:1789760550.077206:0:6750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c652680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:6750:1876699882989056:0@lo:502: 00000020:01000000:1.0:1789760550.077243:0:6750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789760550.077249:0:6750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760550.077252:0:6750:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789760550.077263:0:6750:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1789760550.077376:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1789760550.077392:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789760550.077401:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df243a66200/0x3e099f5ef04ada0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ada13 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760550.077412:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8df243a66200/0x3e099f5ef04ada0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ada13 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760550.077421:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789760550.077423:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df2457ba800 from 1 10000000:01000000:1.0:1789760550.077425:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789760550.077450:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241486e00/0x3e099f5ef04ada36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760550.077458:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8df241486e00/0x3e099f5ef04ada36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760550.077467:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8df241486e00/0x3e099f5ef04ada36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760550.077482:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c652680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882989440:0@lo:101: 00000100:00100000:1.0:1789760550.077517:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760550.077547:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df260088180 going to sleep for 11 seconds 00000100:00100000:1.0:1789760550.077564:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882989440 00000100:00100000:1.0:1789760550.077570:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882989440 00000100:00100000:1.0:1789760550.077599:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789760550.077607:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247855c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+14:5842:x1876699882989440:12345-0@lo:101: 00010000:00010000:1.0:1789760550.077618:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760550.077631:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241487200/0x3e099f5ef04ada3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04ada36 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760550.077658:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241487200/0x3e099f5ef04ada3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04ada36 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760550.077669:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241487200/0x3e099f5ef04ada3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ada36 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760550.077678:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241487200, rc 0) 00000100:00100000:1.0:1789760550.077709:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247855c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+15:5842:x1876699882989440:12345-0@lo:101: Request processed in 104us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760550.077715:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789760550.077745:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c652680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882989440:0@lo:101: 00010000:00010000:1.0:1789760550.077766:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8df241486e00/0x3e099f5ef04ada36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ada3d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760550.077775:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8df241486e00/0x3e099f5ef04ada36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04ada3d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760550.077850:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c652680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882989568:0@lo:501: 00000100:00100000:1.0:1789760550.077874:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760550.077886:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df260088180 going to sleep for 11 seconds 00000100:00100000:1.0:1789760550.077897:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882989568 00000100:00100000:1.0:1789760550.077900:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882989568 00000100:00100000:1.0:1789760550.077920:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789760550.077926:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247854050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+15:5842:x1876699882989568:12345-0@lo:501: 00000004:00080000:3.0:1789760550.078416:0:6759:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789760550.078522:0:6759:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 154191719427ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789760550.088717:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247854050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+15:5842:x1876699882989568:12345-0@lo:501: Request processed in 10782us (10832us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760550.088730:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789760550.089096:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c652680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882989568:0@lo:501: 00000100:00100000:2.0:1789760550.089145:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882989696:0@lo:503: 00000100:00100000:2.0:1789760550.089194:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789760550.099349:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760550.101334:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882989696 00000100:00100000:1.0:1789760550.101348:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882989696 00000100:00100000:1.0:1789760550.101399:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789760550.101408:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+15:5842:x1876699882989696:12345-0@lo:503: 00000100:00100000:1.0:1789760550.109221:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+15:5842:x1876699882989696:12345-0@lo:503: Request processed in 7806us (20018us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760550.109235:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789760550.111275:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df27de56240 going to sleep for 11 seconds 00000100:00100000:3.0:1789760550.111310:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882989696:0@lo:503: 00000100:00100000:3.0:1789760550.115729:0:6766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cd8d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:6766:1876699882989824:0@lo:502: 00000100:00100000:3.0:1789760550.115836:0:6766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760550.115871:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882989824 00000100:00100000:3.0:1789760550.115878:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882989824 00000100:00100000:3.0:1789760550.115919:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789760550.115927:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258609050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+15:6766:x1876699882989824:12345-0@lo:502: 00000100:00100000:3.0:1789760550.118424:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258609050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+15:6766:x1876699882989824:12345-0@lo:502: Request processed in 2490us (2581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760550.118436:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789760550.118516:0:6766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df24f308f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789760550.118540:0:6766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cd8d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:6766:1876699882989824:0@lo:502: 00000020:01000000:3.0:1789760550.118576:0:6766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789760550.118592:0:6766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760550.118595:0:6766:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789760550.118601:0:6766:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df2457ba800 00000020:00000080:3.0:1789760550.118604:0:6766:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789760550.118637:0:6766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cd8d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:6766:1876699882989952:0@lo:502: 00000100:00100000:3.0:1789760550.118675:0:6766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760550.118703:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882989952 00000100:00100000:3.0:1789760550.118708:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882989952 00000100:00100000:3.0:1789760550.118736:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789760550.118743:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25860b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+15:6766:x1876699882989952:12345-0@lo:502: 00000100:00100000:3.0:1789760550.118886:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25860b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+15:6766:x1876699882989952:12345-0@lo:502: Request processed in 142us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760550.118892:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789760550.118922:0:6766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df24f308f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789760550.118933:0:6766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cd8d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:6766:1876699882989952:0@lo:502: 00000020:01000000:3.0:1789760550.118949:0:6766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789760550.118954:0:6766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760550.118955:0:6766:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789760550.118958:0:6766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1789760550.123960:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789760550.124279:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789760550.124291:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241486e00/0x3e099f5ef04ada36 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ada3d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760550.124303:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8df241486e00/0x3e099f5ef04ada36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ada3d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760550.124325:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789760550.124328:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8df2598e3370 from 1 10000000:01000000:2.0:1789760550.124331:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789760550.124368:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241538c00/0x3e099f5ef04ada44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760550.124375:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8df241538c00/0x3e099f5ef04ada44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760550.124385:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8df241538c00/0x3e099f5ef04ada44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760550.124410:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0edc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882990080:0@lo:101: 00000100:00100000:2.0:1789760550.124479:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760550.125396:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df27de56180 going to sleep for 11 seconds 00000100:00100000:3.0:1789760550.126135:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882990080 00000100:00100000:3.0:1789760550.126144:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882990080 00000100:00100000:3.0:1789760550.126248:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789760550.126257:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+15:5842:x1876699882990080:12345-0@lo:101: 00010000:00010000:3.0:1789760550.126272:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760550.126288:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241674e00/0x3e099f5ef04ada4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04ada44 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760550.126313:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241674e00/0x3e099f5ef04ada4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04ada44 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760550.126339:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241674e00/0x3e099f5ef04ada4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ada44 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760550.126348:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241674e00, rc 0) 00000100:00100000:3.0:1789760550.126409:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+16:5842:x1876699882990080:12345-0@lo:101: Request processed in 153us (1929us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760550.126416:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789760550.126470:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0edc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882990080:0@lo:101: 00010000:00010000:3.0:1789760550.126496:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8df241538c00/0x3e099f5ef04ada44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ada4b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760550.126505:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8df241538c00/0x3e099f5ef04ada44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04ada4b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760550.126560:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cd8d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882990208:0@lo:501: 00000100:00100000:3.0:1789760550.126589:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760550.126613:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df24f308300 going to sleep for 11 seconds 00000100:00100000:3.0:1789760550.126624:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882990208 00000100:00100000:3.0:1789760550.126628:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882990208 00000100:00100000:3.0:1789760550.126648:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789760550.126655:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+16:5842:x1876699882990208:12345-0@lo:501: 00000100:00100000:3.0:1789760550.126983:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+16:5842:x1876699882990208:12345-0@lo:501: Request processed in 317us (383us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789760550.126991:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789760550.127018:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cd8d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882990208:0@lo:501: 10000000:01000000:3.0:1789760550.127042:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789760550.127055:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241538c00/0x3e099f5ef04ada44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ada4b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760550.127064:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8df241538c00/0x3e099f5ef04ada44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ada4b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789760550.170311:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1789760550.207961:0:6760:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789760550.208003:0:6760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ed180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6760:1876699882990464:0@lo:7: 00000100:00100000:2.0:1789760550.208074:0:6760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760550.208125:0:6760:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df2598f7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760550.208316:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699882990336:0@lo:13: 00000100:00100000:3.0:1789760550.208350:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760550.208431:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882990336 00000100:00100000:2.0:1789760550.208438:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882990336 00000100:00100000:0.0:1789760550.208468:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882990464 00000100:00100000:0.0:1789760550.208472:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882990464 00000100:00100000:0.0:1789760550.208504:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789760550.208504:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789760550.208512:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:6760:x1876699882990464:12345-0@lo:7: 00000100:00100000:2.0:1789760550.208512:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1876699882990336:12345-0@lo:13: 00002000:00000024:2.0:1789760550.208530:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:2.0:1789760550.208568:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1876699882990336:12345-0@lo:13: Request processed in 56us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760550.208588:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789760550.208697:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27d0ed500 x1876699882990336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760566 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760550.208713:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699882990336:0@lo:13: 00000100:00080000:2.0:1789760550.211886:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1789760550.225731:0:6695:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1789760550.225740:0:6695:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789760550.225875:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6760:x1876699882990464:12345-0@lo:7: Request processed in 17359us (17796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760550.225887:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789760550.228060:0:6760:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27d0ed180 x1876699882990464/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789760566 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760550.228079:0:6760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ed180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6760:1876699882990464:0@lo:7: 00000004:00080000:2.0:1789760550.228093:0:6760:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789760550.228135:0:6760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ed180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6760:1876699882990592:0@lo:5: 00000100:00100000:2.0:1789760550.228217:0:6760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760550.228263:0:6760:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df2598f7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760550.228507:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882990592 00000100:00100000:3.0:1789760550.228515:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882990592 00000100:00100000:3.0:1789760550.228567:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789760550.228576:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6760:x1876699882990592:12345-0@lo:5: 00002000:00080000:3.0:1789760550.228601:0:6694:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789760550.228604:0:6694:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1789760550.228942:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6760:x1876699882990592:12345-0@lo:5: Request processed in 366us (724us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789760550.228950:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789760550.232267:0:6760:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27d0ed180 x1876699882990592/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789760566 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760550.232289:0:6760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ed180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6760:1876699882990592:0@lo:5: 00000004:00080000:0.0:1789760550.232302:0:6760:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789760550.232355:0:6760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25855a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6760:1876699882990720:0@lo:700: 00000100:00100000:0.0:1789760550.232413:0:6760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760550.232460:0:6760:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df258fe6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789760550.232668:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882990720 00000100:00100000:1.0:1789760550.232675:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882990720 00000100:00100000:1.0:1789760550.232725:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789760550.232734:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258559c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6760:x1876699882990720:12345-0@lo:700: 00000100:00100000:1.0:1789760550.232895:0:6701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c651180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6701:1876699882990848:0@lo:700: 00000100:00100000:1.0:1789760550.232927:0:6701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760550.234461:0:6701:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df24502e780 going to sleep for 11 seconds 00000100:00100000:3.0:1789760550.236039:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882990848 00000100:00100000:3.0:1789760550.236054:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882990848 00000100:00100000:3.0:1789760550.236107:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789760550.236117:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6701:x1876699882990848:12345-0@lo:700: 40000000:02000000:3.0:1789760550.329957:0:5851:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1789760550.340562:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6701:x1876699882990848:12345-0@lo:700: Request processed in 104439us (107626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760550.340586:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789760550.340732:0:6701:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27c651180 x1876699882990848/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789760566 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760550.340748:0:6701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c651180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6701:1876699882990848:0@lo:700: 40000000:02000000:2.0:1789760550.340776:0:6701:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:1.0:1789760550.510090:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789760550.510106:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:0.0:1789760550.510310:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258559c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6760:x1876699882990720:12345-0@lo:700: Request processed in 277572us (277892us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760550.510347:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789760550.510405:0:6760:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df25855a300 x1876699882990720/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789760566 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760550.510416:0:6760:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789760550.510431:0:6760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25855a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6760:1876699882990720:0@lo:700: 00000004:02000040:0.0:1789760550.577348:0:6760:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1789760550.586895:0:6760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25855a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6760:1876699882990976:0@lo:5: 00000100:00100000:0.0:1789760550.586965:0:6760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760550.587176:0:6760:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df258fe6840 going to sleep for 11 seconds 00000100:00100000:2.0:1789760550.587290:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882990976 00000100:00100000:2.0:1789760550.587298:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882990976 00000100:00100000:2.0:1789760550.587354:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789760550.587363:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258559500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6760:x1876699882990976:12345-0@lo:5: 00002000:00080000:0.0:1789760550.598159:0:6695:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1789760550.598182:0:6695:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1789760550.602075:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258559500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6760:x1876699882990976:12345-0@lo:5: Request processed in 14706us (15101us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789760550.602088:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789760550.602339:0:6760:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df25855a300 x1876699882990976/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789760566 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760550.602356:0:6760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25855a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6760:1876699882990976:0@lo:5: 00000004:00080000:1.0:1789760550.602370:0:6760:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1789760551.119484:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760552.142971:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760553.167302:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760554.192818:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760555.088104:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699882991488:0@lo:400: 00000100:00100000:2.0:1789760555.088171:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760555.088226:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789760555.088232:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699882991104:0@lo:400: 00000100:00100000:2.0:1789760555.088263:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760555.088292:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876699882991232:0@lo:400: 00000100:00100000:2.0:1789760555.088320:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760555.088347:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789760555.088355:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699882991360:0@lo:400: 00000100:00100000:2.0:1789760555.088376:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760555.088405:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882991488 00000100:00100000:2.0:1789760555.088411:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882991488 00000100:00100000:2.0:1789760555.088457:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789760555.088466:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1876699882991488:12345-0@lo:400: 00000100:00100000:2.0:1789760555.088515:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1876699882991488:12345-0@lo:400: Request processed in 50us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760555.088522:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789760555.088556:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882991104 00000100:00100000:2.0:1789760555.088560:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882991104 00000100:00100000:2.0:1789760555.088587:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789760555.088593:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+16:3310:x1876699882991104:12345-0@lo:400: 00000100:00100000:2.0:1789760555.088621:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+16:3310:x1876699882991104:12345-0@lo:400: Request processed in 28us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760555.088626:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789760555.088650:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882991232 00000100:00100000:2.0:1789760555.088654:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882991232 00000100:00100000:2.0:1789760555.088675:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882991360 00000100:00100000:2.0:1789760555.088678:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882991360 00000100:00100000:2.0:1789760555.088693:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789760555.088698:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876699882991232:12345-0@lo:400: 00000100:00100000:2.0:1789760555.088749:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876699882991232:12345-0@lo:400: Request processed in 51us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760555.088755:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789760555.088767:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789760555.088773:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699882991360:12345-0@lo:400: 00000100:00100000:2.0:1789760555.088844:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699882991360:12345-0@lo:400: Request processed in 72us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760555.088851:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1789760555.088870:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789760555.088874:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789760555.088906:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27d0eea00 x1876699882991360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760555.088920:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699882991360:0@lo:400: 00010000:00080000:2.0:1789760555.088931:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27d0ece00 x1876699882991232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760555.088939:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876699882991232:0@lo:400: 00000100:00100000:2.0:1789760555.088965:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699882991104:0@lo:400: 00010000:00080000:2.0:1789760555.088974:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27d0ec700 x1876699882991488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760555.088981:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699882991488:0@lo:400: 00000001:02000400:1.0:1789760555.123997:0:7063:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789760555.226157:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760555.606399:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cd8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699882991616:0@lo:13: 00000100:00100000:3.0:1789760555.606498:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760555.606860:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882991616 00000100:00100000:2.0:1789760555.606871:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882991616 00000100:00100000:2.0:1789760555.606947:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789760555.606959:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876699882991616:12345-0@lo:13: 00002000:00000024:2.0:1789760555.607001:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760555.607058:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876699882991616:12345-0@lo:13: Request processed in 101us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760555.607067:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789760555.607122:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27cd8c000 x1876699882991616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760555.607173:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cd8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699882991616:0@lo:13: 00000001:00080000:1.0:1789760555.708117:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1789760556.245155:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760557.263095:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760558.287012:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760559.311180:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760560.207250:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cd8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699882991744:0@lo:400: 00000100:00100000:3.0:1789760560.207323:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760560.207381:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882991744 00000100:00100000:3.0:1789760560.207389:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789760560.207391:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882991744 00000100:00100000:3.0:1789760560.207397:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cd8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876699882991872:0@lo:400: 00000100:00100000:3.0:1789760560.207427:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760560.207445:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789760560.207456:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+16:3308:x1876699882991744:12345-0@lo:400: 00000100:00100000:3.0:1789760560.207462:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cd8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1876699882992000:0@lo:400: 00000100:00100000:3.0:1789760560.207487:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760560.207508:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789760560.207514:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cd8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699882992128:0@lo:400: 00000100:00100000:0.0:1789760560.207524:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+16:3308:x1876699882991744:12345-0@lo:400: Request processed in 69us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760560.207533:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789760560.207543:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760560.207578:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882991872 00000100:00100000:3.0:1789760560.207582:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882991872 00000100:00100000:3.0:1789760560.207618:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882992000 00000100:00100000:3.0:1789760560.207622:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882992000 00000100:00100000:3.0:1789760560.207647:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789760560.207654:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876699882991872:12345-0@lo:400: 00000100:00100000:0.0:1789760560.207672:0:5845:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789760560.207698:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876699882991872:12345-0@lo:400: Request processed in 45us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760560.207699:0:5845:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789760560.207709:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789760560.207724:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789760560.207731:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876699882992000:12345-0@lo:400: 00000100:00100000:3.0:1789760560.207767:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876699882992000:12345-0@lo:400: Request processed in 37us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760560.207782:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789760560.207820:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882992128 00000100:00100000:3.0:1789760560.207823:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882992128 00000100:00100000:3.0:1789760560.207847:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789760560.207853:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699882992128:12345-0@lo:400: 00000100:00100000:3.0:1789760560.207884:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699882992128:12345-0@lo:400: Request processed in 31us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760560.207889:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789760560.207902:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789760560.207906:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789760560.208310:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27cd8d500 x1876699882992128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760560.208322:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789760560.208352:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cd8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699882992128:0@lo:400: 00010000:00080000:0.0:1789760560.208366:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27cd8dc00 x1876699882992000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760560.208374:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cd8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1876699882992000:0@lo:400: 00010000:00080000:3.0:1789760560.211294:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27cd8e300 x1876699882991872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760560.211312:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cd8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876699882991872:0@lo:400: 00000100:00100000:3.0:1789760560.211324:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cd8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699882991744:0@lo:400: 00010000:00010000:1.0:1789760560.338108:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760560.729188:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25855a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699882992256:0@lo:13: 00000100:00100000:0.0:1789760560.729253:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760560.731426:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882992256 00000100:00100000:2.0:1789760560.731438:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882992256 00000100:00100000:2.0:1789760560.731492:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789760560.731501:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258559180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699882992256:12345-0@lo:13: 00002000:00000024:2.0:1789760560.731533:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760560.731599:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258559180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699882992256:12345-0@lo:13: Request processed in 100us (2346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760560.731606:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789760560.731738:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df25855a300 x1876699882992256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760560.731758:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25855a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699882992256:0@lo:13: 00010000:00010000:2.0:1789760561.359125:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760562.398411:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760563.409316:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760564.431361:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760565.333488:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258558a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876699882992512:0@lo:400: 00000100:00100000:0.0:1789760565.333594:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760565.333676:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789760565.333683:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258559f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1876699882992640:0@lo:400: 00000100:00100000:0.0:1789760565.333709:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760565.333908:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25855ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699882992768:0@lo:400: 00000100:00100000:1.0:1789760565.333947:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760565.333998:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789760565.334004:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25855a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699882992384:0@lo:400: 00000100:00100000:1.0:1789760565.334034:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760565.334106:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882992384 00000100:00100000:1.0:1789760565.334115:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882992384 00000100:00100000:1.0:1789760565.334174:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789760565.334185:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+16:3308:x1876699882992384:12345-0@lo:400: 00000100:00100000:1.0:1789760565.334240:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+16:3308:x1876699882992384:12345-0@lo:400: Request processed in 57us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760565.334248:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789760565.334304:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25855a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699882992384:0@lo:400: 00000100:00100000:0.0:1789760565.334527:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882992768 00000100:00100000:0.0:1789760565.334532:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882992768 00000100:00100000:0.0:1789760565.334716:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789760565.334725:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c653b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699882992768:12345-0@lo:400: 00000100:00100000:0.0:1789760565.334769:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c653b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699882992768:12345-0@lo:400: Request processed in 46us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760565.334776:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789760565.335590:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789760565.335632:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df25855ad80 x1876699882992768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760565.335743:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25855ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699882992768:0@lo:400: 00000100:00100000:3.0:1789760565.335916:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882992512 00000100:00100000:3.0:1789760565.335922:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882992512 00000100:00100000:3.0:1789760565.335965:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882992640 00000100:00100000:3.0:1789760565.335969:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882992640 00000100:00100000:3.0:1789760565.335996:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789760565.336003:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25855a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876699882992512:12345-0@lo:400: 00000100:00100000:3.0:1789760565.336083:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25855a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876699882992512:12345-0@lo:400: Request processed in 70us (2479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760565.336091:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789760565.336107:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789760565.336114:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25855b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876699882992640:12345-0@lo:400: 00000100:00100000:3.0:1789760565.336144:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25855b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876699882992640:12345-0@lo:400: Request processed in 30us (2434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760565.336160:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789760565.336198:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df258559f80 x1876699882992640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760565.336210:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258559f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1876699882992640:0@lo:400: 00010000:00080000:3.0:1789760565.336223:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df258558a80 x1876699882992512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760565.336233:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258558a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876699882992512:0@lo:400: 00000100:00080000:1.0:1789760565.336438:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789760565.462633:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760565.842937:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cd8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699882992896:0@lo:13: 00000100:00100000:2.0:1789760565.843035:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760565.843126:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882992896 00000100:00100000:2.0:1789760565.843136:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882992896 00000100:00100000:2.0:1789760565.843189:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789760565.843199:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699882992896:12345-0@lo:13: 00002000:00000024:2.0:1789760565.843245:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760565.843292:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699882992896:12345-0@lo:13: Request processed in 94us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760565.843300:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789760565.843377:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df27cd8fb80 x1876699882992896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760565.843397:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cd8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699882992896:0@lo:13: 00010000:00010000:1.0:1789760566.479103:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789760567.064605:0:7638:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789760567.064611:0:7638:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1789760567.065017:0:7638:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8df26cd8e800 00000020:01000004:2.0:1789760567.065038:0:7638:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789760567.065054:0:7638:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789760567.065073:0:7638:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8df258458000) 00000020:00000080:2.0:1789760567.065093:0:7638:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789760567.085111:0:7638:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789760567.085441:0:7638:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1789760567.106458:0:7638:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1789760567.110620:0:7638:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789760567.110675:0:7638:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1789760567.110740:0:7638:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789760567.110771:0:7638:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1789760567.111252:0:7638:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1789760567.111267:0:7638:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789760567.111286:0:7638:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3e099f5ef04ada59 00000020:01000004:1.0:1789760567.111295:0:7638:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1789760567.111326:0:7638:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789760567.111330:0:7638:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789760567.111336:0:7638:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1789760567.111361:0:7638:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1789760567.111367:0:7638:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789760567.126468:0:7638:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789760567.126512:0:7638:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.112@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1789760567.126516:0:7638:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789760567.126517:0:7638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789760567.126518:0:7638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789760567.126519:0:7638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789760567.126520:0:7638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789760567.126521:0:7638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789760567.126522:0:7638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789760567.126523:0:7638:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789760567.126524:0:7638:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789760567.126525:0:7638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789760567.126526:0:7638:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789760567.126530:0:7638:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1789760567.126532:0:7638:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789760567.126532:0:7638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789760567.126533:0:7638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789760567.126534:0:7638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789760567.126534:0:7638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789760567.126535:0:7638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789760567.126535:0:7638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789760567.126536:0:7638:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789760567.126536:0:7638:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789760567.126537:0:7638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789760567.126538:0:7638:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789760567.126570:0:7638:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789760567.126590:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c651180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882993024:0@lo:253: 00000100:00100000:1.0:1789760567.126703:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760567.126778:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df258fe63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760567.126929:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882993024 00000100:00100000:2.0:1789760567.126939:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882993024 00000100:00100000:2.0:1789760567.127005:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789760567.127014:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+16:7638:x1876699882993024:12345-0@lo:253: 20000000:01000000:2.0:1789760567.127255:0:5837:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789760567.127260:0:5837:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1789760567.127264:0:5837:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1789760567.127268:0:5837:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1789760567.128500:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789760567.128729:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1789760567.128744:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1789760567.128779:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1789760567.128786:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1789760567.128845:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1789760567.128913:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1789760567.129272:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1789760567.129294:0:5837:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.112@tcp 20000000:01000000:3.0:1789760567.129296:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:3.0:1789760567.129343:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1789760567.129351:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789760567.129391:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1789760567.129398:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:3.0:1789760567.129425:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1789760567.129434:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789760567.129460:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1789760567.129501:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1789760567.130376:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1789760567.130396:0:5837:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.112@tcp 20000000:01000000:3.0:1789760567.130407:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:3.0:1789760567.130440:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1789760567.130447:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789760567.130473:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1789760567.130479:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:3.0:1789760567.130968:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1789760567.130980:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789760567.131298:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1789760567.131339:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1789760567.131358:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789760567.131362:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789760567.131366:0:5837:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789760567.131382:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789760567.131385:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789760567.131423:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789760567.131426:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789760567.132073:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1789760567.132122:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1789760567.132167:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1789760567.132449:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1789760567.132494:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1789760567.132528:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1789760567.132543:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789760567.132546:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789760567.133334:0:7642:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1789760567.133398:0:7642:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1789760567.133450:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1789760567.134197:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1789760567.134243:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1789760567.134331:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1789760567.134349:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789760567.134351:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789760567.135196:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1789760567.135571:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1789760567.135612:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1789760567.135704:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1789760567.135727:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789760567.135730:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789760567.136423:0:7644:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1789760567.136494:0:7644:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1789760567.136522:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1789760567.137131:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1789760567.137236:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1789760567.137290:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1789760567.137308:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1789760567.137311:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1789760567.137332:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789760567.137359:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df241675400/0x3e099f5ef04ada60 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.137384:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df243a66a00/0x3e099f5ef04ad9a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ad99c expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.137393:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df241539600/0x3e099f5ef04ad9cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ad9c6 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.137401:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df241539c00/0x3e099f5ef04ad9f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ad9f0 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.137408:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df241675a00/0x3e099f5ef04ada13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ada0c expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.137415:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df241674e00/0x3e099f5ef04ada4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ada44 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.137423:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df241675400/0x3e099f5ef04ada60 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.137474:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df241674e00/0x3e099f5ef04ada4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e099f5ef04ada44 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.137491:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df241674e00/0x3e099f5ef04ada4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e099f5ef04ada44 expref: 16 pid: 5838 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760567.137508:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cd8e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1876699882993152:0@lo:104: 00000100:00100000:3.0:1789760567.137677:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760567.137835:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789760567.137859:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882993152 00000100:00100000:2.0:1789760567.137867:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882993152 00000100:00100000:2.0:1789760567.137918:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789760567.137928:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2594a4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e2780560-8e82-4256-94b0-2e524f3bed06+3:5837:x1876699882993152:12345-0@lo:104: 00010000:00010000:2.0:1789760567.137943:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8df241538c00/0x3e099f5ef04ada44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ada4b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760567.138003:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789760567.138010:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2594a4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e2780560-8e82-4256-94b0-2e524f3bed06+3:5837:x1876699882993152:12345-0@lo:104: Request processed in 83us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760567.138017:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789760567.138202:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789760567.138210:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8df241538c00/0x3e099f5ef04ada44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ada4b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760567.138218:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241538c00 already unused, calling callback (ffffffffc1be8c20) 10000000:00010000:0.0:1789760567.138222:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8df241538c00/0x3e099f5ef04ada44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e099f5ef04ada4b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760567.138228:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8df241538c00/0x3e099f5ef04ada44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e099f5ef04ada4b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760567.138234:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8df241538c00/0x3e099f5ef04ada44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e099f5ef04ada4b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760567.138239:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789760567.138253:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df241675a00/0x3e099f5ef04ada13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e099f5ef04ada0c expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.138274:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df241675a00/0x3e099f5ef04ada13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e099f5ef04ada0c expref: 16 pid: 5839 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760567.138277:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8df241538c00/0x3e099f5ef04ada44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ada4b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760567.138287:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789760567.138291:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cd8c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1876699882993280:0@lo:104: 00010000:00010000:0.0:1789760567.138313:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8df241538c00/0x3e099f5ef04ada44 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ada4b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760567.138318:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258558700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699882993408:0@lo:103: 00010000:00010000:0.0:1789760567.138322:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8df241538c00/0x3e099f5ef04ada44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ada4b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760567.138335:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760567.138337:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760567.138339:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760567.138354:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760567.138417:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789760567.138448:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df241539c00/0x3e099f5ef04ad9f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e099f5ef04ad9f0 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.138456:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df241539c00/0x3e099f5ef04ad9f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e099f5ef04ad9f0 expref: 16 pid: 5839 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760567.138465:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cd8fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1876699882993536:0@lo:104: 00000100:00100000:0.0:1789760567.138483:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882993408 00000100:00100000:3.0:1789760567.138487:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760567.138488:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882993408 00010000:00010000:0.0:1789760567.138509:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df241674e00/0x3e099f5ef04ada4b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ada44 expref: 17 pid: 5838 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760567.138513:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882993280 00000100:00100000:3.0:1789760567.138518:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882993280 00000100:00100000:0.0:1789760567.138532:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789760567.138539:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2780560-8e82-4256-94b0-2e524f3bed06+17:3310:x1876699882993408:12345-0@lo:103: 00010000:00010000:0.0:1789760567.138548:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789760567.138551:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882993536 00010000:00010000:0.0:1789760567.138553:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df241674e00/0x3e099f5ef04ada4b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ada44 expref: 17 pid: 5838 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760567.138556:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882993536 00010000:00010000:0.0:1789760567.138565:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df241674e00/0x3e099f5ef04ada4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e099f5ef04ada44 expref: 17 pid: 5838 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760567.138578:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1789760567.138580:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760567.138587:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e2780560-8e82-4256-94b0-2e524f3bed06+4:5837:x1876699882993280:12345-0@lo:104: 00010000:00010000:3.0:1789760567.138596:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8df243a66200/0x3e099f5ef04ada0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ada13 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760567.138610:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2780560-8e82-4256-94b0-2e524f3bed06+17:3310:x1876699882993408:12345-0@lo:103: Request processed in 72us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760567.138616:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789760567.138649:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789760567.138656:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e2780560-8e82-4256-94b0-2e524f3bed06+4:5837:x1876699882993280:12345-0@lo:104: Request processed in 71us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760567.138671:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789760567.138686:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789760567.138691:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e2780560-8e82-4256-94b0-2e524f3bed06+3:5837:x1876699882993536:12345-0@lo:104: 00010000:00010000:3.0:1789760567.138698:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8df241674200/0x3e099f5ef04ad9f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ad9f7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.138744:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789760567.138749:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e2780560-8e82-4256-94b0-2e524f3bed06+3:5837:x1876699882993536:12345-0@lo:104: Request processed in 59us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760567.138755:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1789760567.138772:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789760567.138777:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8df243a66200/0x3e099f5ef04ada0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ada13 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.138785:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66200 already unused, calling callback (ffffffffc1be8c20) 10000000:00010000:3.0:1789760567.138788:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8df243a66200/0x3e099f5ef04ada0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e099f5ef04ada13 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.138796:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8df243a66200/0x3e099f5ef04ada0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e099f5ef04ada13 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760567.138826:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8df243a66200/0x3e099f5ef04ada0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e099f5ef04ada13 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760567.138832:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789760567.138847:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8df243a66200/0x3e099f5ef04ada0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ada13 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.138853:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760567.138867:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8df243a66200/0x3e099f5ef04ada0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ada13 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.138875:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8df243a66200/0x3e099f5ef04ada0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ada13 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.138884:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760567.138887:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8df241674200/0x3e099f5ef04ad9f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ad9f7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.138893:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674200 already unused, calling callback (ffffffffc1be8c20) 10000000:00010000:3.0:1789760567.138896:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8df241674200/0x3e099f5ef04ad9f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e099f5ef04ad9f7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.138903:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8df241674200/0x3e099f5ef04ad9f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e099f5ef04ad9f7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760567.138909:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8df241674200/0x3e099f5ef04ad9f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e099f5ef04ad9f7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760567.138914:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789760567.138925:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8df241674200/0x3e099f5ef04ad9f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ad9f7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.138932:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760567.138945:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8df241674200/0x3e099f5ef04ad9f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ad9f7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.138952:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8df241674200/0x3e099f5ef04ad9f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ad9f7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.138966:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760567.138973:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760567.138976:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760567.138988:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cd8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699882993792:0@lo:103: 00000100:00100000:3.0:1789760567.139016:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760567.139060:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cd8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699882993664:0@lo:103: 00000100:00100000:3.0:1789760567.139081:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760567.139134:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258558700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699882993408:0@lo:103: 00000100:00100000:3.0:1789760567.139170:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882993792 00000100:00100000:3.0:1789760567.139173:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882993792 00010000:00010000:3.0:1789760567.139187:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df241539c00/0x3e099f5ef04ad9f7 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ad9f0 expref: 17 pid: 5839 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760567.139203:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882993664 00000100:00100000:3.0:1789760567.139206:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882993664 00010000:00010000:3.0:1789760567.139214:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df241675a00/0x3e099f5ef04ada13 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ada0c expref: 18 pid: 5839 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760567.139222:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789760567.139238:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2780560-8e82-4256-94b0-2e524f3bed06+18:3308:x1876699882993792:12345-0@lo:103: 00010000:00010000:2.0:1789760567.139249:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760567.139255:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df241539c00/0x3e099f5ef04ad9f7 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ad9f0 expref: 18 pid: 5839 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760567.139267:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df241539c00/0x3e099f5ef04ad9f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e099f5ef04ad9f0 expref: 18 pid: 5839 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760567.139279:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760567.139296:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760567.139307:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2780560-8e82-4256-94b0-2e524f3bed06+18:3308:x1876699882993792:12345-0@lo:103: Request processed in 78us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760567.139647:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789760567.139657:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1789760567.139664:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789760567.139753:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789760567.139759:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2780560-8e82-4256-94b0-2e524f3bed06+17:3311:x1876699882993664:12345-0@lo:103: 00010000:00010000:2.0:1789760567.139766:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760567.139769:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df241675a00/0x3e099f5ef04ada13 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ada0c expref: 17 pid: 5839 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760567.139782:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df241675a00/0x3e099f5ef04ada13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e099f5ef04ada0c expref: 17 pid: 5839 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760567.139791:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760567.139841:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2780560-8e82-4256-94b0-2e524f3bed06+17:3311:x1876699882993664:12345-0@lo:103: Request processed in 83us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760567.139846:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789760567.140016:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cd8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699882993792:0@lo:103: 00000100:00100000:0.0:1789760567.140126:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cd8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699882993664:0@lo:103: 00010000:00010000:3.0:1789760567.140236:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df241539600/0x3e099f5ef04ad9cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e099f5ef04ad9c6 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.140249:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df241539600/0x3e099f5ef04ad9cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e099f5ef04ad9c6 expref: 16 pid: 5838 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760567.140261:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cd8c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1876699882993920:0@lo:104: 00000100:00100000:3.0:1789760567.140290:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760567.140331:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882993920 00010000:00010000:3.0:1789760567.140337:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df243a66a00/0x3e099f5ef04ad9a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e099f5ef04ad99c expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760567.140340:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882993920 00010000:00010000:3.0:1789760567.140353:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df243a66a00/0x3e099f5ef04ad9a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e099f5ef04ad99c expref: 16 pid: 5839 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760567.140364:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747f9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1876699882994048:0@lo:104: 00000100:00100000:3.0:1789760567.140386:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760567.140396:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259abf000 going to sleep for 11 seconds 00000100:00100000:2.0:1789760567.140398:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882994048 00000100:00100000:2.0:1789760567.140403:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882994048 00010000:00010000:3.0:1789760567.140412:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241674e00/0x3e099f5ef04ada4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e099f5ef04ada44 expref: 16 pid: 5838 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760567.140422:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789760567.140426:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cd8e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1876699882993152:0@lo:104: 00000100:00100000:2.0:1789760567.140433:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e2780560-8e82-4256-94b0-2e524f3bed06+4:5837:x1876699882993920:12345-0@lo:104: 00010000:00010000:3.0:1789760567.140439:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241675a00/0x3e099f5ef04ada13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e099f5ef04ada0c expref: 15 pid: 5839 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760567.140446:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8df243a67200/0x3e099f5ef04ad9c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ad9cd expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760567.140451:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cd8c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1876699882993280:0@lo:104: 00010000:00010000:3.0:1789760567.140465:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241539c00/0x3e099f5ef04ad9f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e099f5ef04ad9f0 expref: 14 pid: 5839 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760567.140474:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cd8fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1876699882993536:0@lo:104: 00000100:00100000:3.0:1789760567.140508:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cd8c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1876699882993920:0@lo:104: 00010000:00010000:2.0:1789760567.140515:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789760567.140518:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789760567.140524:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e2780560-8e82-4256-94b0-2e524f3bed06+4:5837:x1876699882993920:12345-0@lo:104: Request processed in 92us (232us total) trans 0 rc 0/0 00010000:00010000:3.0:1789760567.140526:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8df243a67200/0x3e099f5ef04ad9c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ad9cd expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760567.140537:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789760567.140553:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789760567.140559:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e2780560-8e82-4256-94b0-2e524f3bed06+3:5837:x1876699882994048:12345-0@lo:104: 00010000:00010000:2.0:1789760567.140566:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8df241539400/0x3e099f5ef04ad99c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ad9a3 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760567.140600:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789760567.140605:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e2780560-8e82-4256-94b0-2e524f3bed06+3:5837:x1876699882994048:12345-0@lo:104: Request processed in 47us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760567.140622:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1789760567.140661:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67200 already unused, calling callback (ffffffffc1be8c20) 10000000:00010000:3.0:1789760567.140666:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8df243a67200/0x3e099f5ef04ad9c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e099f5ef04ad9cd expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.140685:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8df243a67200/0x3e099f5ef04ad9c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e099f5ef04ad9cd expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760567.140692:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8df243a67200/0x3e099f5ef04ad9c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e099f5ef04ad9cd expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760567.140699:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789760567.140765:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760567.140839:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8df243a67200/0x3e099f5ef04ad9c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ad9cd expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.140846:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760567.140863:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8df243a67200/0x3e099f5ef04ad9c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ad9cd expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.140871:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8df243a67200/0x3e099f5ef04ad9c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ad9cd expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.140884:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760567.140886:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760567.140889:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760567.140902:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e2780560-8e82-4256-94b0-2e524f3bed06:3309:1876699882994176:0@lo:103: 00000100:00100000:3.0:1789760567.140934:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789760567.140945:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760567.140953:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8df241539400/0x3e099f5ef04ad99c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ad9a3 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760567.140962:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241539400 already unused, calling callback (ffffffffc1be8c20) 10000000:00010000:2.0:1789760567.140966:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8df241539400/0x3e099f5ef04ad99c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e099f5ef04ad9a3 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760567.140974:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8df241539400/0x3e099f5ef04ad99c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e099f5ef04ad9a3 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760567.140978:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882994176 00000100:00100000:3.0:1789760567.140983:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882994176 10000000:00010000:2.0:1789760567.140985:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8df241539400/0x3e099f5ef04ad99c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e099f5ef04ad9a3 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760567.140993:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789760567.141003:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df241539600/0x3e099f5ef04ad9cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ad9c6 expref: 14 pid: 5838 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760567.141023:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789760567.141040:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2780560-8e82-4256-94b0-2e524f3bed06+14:3309:x1876699882994176:12345-0@lo:103: 00010000:00010000:3.0:1789760567.141058:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760567.141063:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df241539600/0x3e099f5ef04ad9cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ad9c6 expref: 14 pid: 5838 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.141073:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df241539600/0x3e099f5ef04ad9cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e099f5ef04ad9c6 expref: 14 pid: 5838 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.141085:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241539600/0x3e099f5ef04ad9cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e099f5ef04ad9c6 expref: 14 pid: 5838 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.141097:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760567.141120:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2780560-8e82-4256-94b0-2e524f3bed06+13:3309:x1876699882994176:12345-0@lo:103: Request processed in 92us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760567.141127:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789760567.141179:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e2780560-8e82-4256-94b0-2e524f3bed06:3309:1876699882994176:0@lo:103: 00000100:00100000:3.0:1789760567.141201:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747f9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1876699882994048:0@lo:104: 00010000:00010000:3.0:1789760567.141224:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df241675400/0x3e099f5ef04ada60 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760567.141421:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8df241539400/0x3e099f5ef04ad99c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ad9a3 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760567.141429:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789760567.141462:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8df241539400/0x3e099f5ef04ad99c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ad9a3 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760567.141476:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8df241539400/0x3e099f5ef04ad99c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ad9a3 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760567.141477:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699882994304:0@lo:103: 00010000:00010000:2.0:1789760567.141504:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760567.141507:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760567.141510:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760567.141515:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789760567.141529:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760567.141533:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760567.141564:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882994304 00000100:00100000:0.0:1789760567.141580:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882994304 00010000:00010000:0.0:1789760567.141651:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df243a66a00/0x3e099f5ef04ad9a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ad99c expref: 13 pid: 5839 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760567.141698:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789760567.141712:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2780560-8e82-4256-94b0-2e524f3bed06+13:3310:x1876699882994304:12345-0@lo:103: 00010000:00010000:0.0:1789760567.141727:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760567.141734:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df243a66a00/0x3e099f5ef04ad9a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ad99c expref: 13 pid: 5839 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760567.141766:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df243a66a00/0x3e099f5ef04ad9a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e099f5ef04ad99c expref: 13 pid: 5839 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760567.141786:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df243a66a00/0x3e099f5ef04ad9a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e099f5ef04ad99c expref: 13 pid: 5839 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760567.141901:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df241675400/0x3e099f5ef04ada60 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760567.141910:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241675400/0x3e099f5ef04ada60 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760567.141928:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df241675400/0x3e099f5ef04ada60 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760567.141936:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df241675400/0x3e099f5ef04ada60 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760567.141943:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df241675400/0x3e099f5ef04ada60 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760567.141950:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df241675400/0x3e099f5ef04ada60 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760567.141957:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241675400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760567.141961:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df241675400/0x3e099f5ef04ada60 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760567.141970:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df241675400/0x3e099f5ef04ada60 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760567.142004:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df241675400/0x3e099f5ef04ada60 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760567.142014:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789760567.142042:0:5837:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df241675400/0x3e099f5ef04ada60 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.142053:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df241675400/0x3e099f5ef04ada60 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.142060:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241675400/0x3e099f5ef04ada60 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789760567.142087:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789760567.142319:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2780560-8e82-4256-94b0-2e524f3bed06+12:3310:x1876699882994304:12345-0@lo:103: Request processed in 602us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760567.142328:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789760567.142649:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699882994304:0@lo:103: 00000100:00100000:2.0:1789760567.235114:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+11:7638:x1876699882993024:12345-0@lo:253: Request processed in 108085us (108396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760567.235133:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789760567.235314:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c651180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882993024:0@lo:253: 10000000:01000000:3.0:1789760567.235336:0:7638:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789760567.235341:0:7638:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789760567.235343:0:7638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789760567.235344:0:7638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789760567.235346:0:7638:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1789760567.235347:0:7638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789760567.235349:0:7638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789760567.235351:0:7638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789760567.235353:0:7638:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789760567.235354:0:7638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789760567.235355:0:7638:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789760567.235383:0:7638:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df26cd8e800 from lustre-OST0001 10000000:01000000:3.0:1789760567.235417:0:7638:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789760567.235419:0:7638:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789760567.235428:0:7638:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8df2598e3370 local copy 10000000:01000000:3.0:1789760567.235432:0:7638:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789760567.235481:0:7638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241675400/0x3e099f5ef04ada67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.235493:0:7638:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.112@tcp lock: ffff8df241675400/0x3e099f5ef04ada67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.235505:0:7638:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8df241675400/0x3e099f5ef04ada67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760567.235525:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882994432:0@lo:101: 00000100:00100000:3.0:1789760567.235575:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760567.235662:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259abf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760567.235961:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882994432 00000100:00100000:2.0:1789760567.235971:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882994432 00000100:00100000:2.0:1789760567.236031:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789760567.236042:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+11:7638:x1876699882994432:12345-0@lo:101: 00010000:00010000:2.0:1789760567.236061:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760567.236080:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241539400/0x3e099f5ef04ada6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04ada67 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760567.236110:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241539400/0x3e099f5ef04ada6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04ada67 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760567.236122:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241539400/0x3e099f5ef04ada6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ada67 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760567.236133:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241539400, rc 0) 00000100:00100000:2.0:1789760567.236180:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+12:7638:x1876699882994432:12345-0@lo:101: Request processed in 140us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760567.236186:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789760567.237306:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882994432:0@lo:101: 00010000:00010000:3.0:1789760567.237337:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8df241675400/0x3e099f5ef04ada67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x3e099f5ef04ada6e expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.237351:0:7638:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8df241675400/0x3e099f5ef04ada67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3e099f5ef04ada6e expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760567.237509:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882994560:0@lo:501: 00000100:00100000:3.0:1789760567.237577:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760567.237627:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259abf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760567.237840:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882994560 00000100:00100000:2.0:1789760567.237854:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882994560 00000100:00100000:2.0:1789760567.237908:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789760567.237918:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+12:7638:x1876699882994560:12345-0@lo:501: 00000100:00100000:2.0:1789760567.238339:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+12:7638:x1876699882994560:12345-0@lo:501: Request processed in 420us (760us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789760567.238360:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789760567.238967:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882994560:0@lo:501: 10000000:01000000:3.0:1789760567.238992:0:7638:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789760567.239035:0:7638:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789760567.239043:0:7638:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241675400/0x3e099f5ef04ada67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3e099f5ef04ada6e expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.239056:0:7638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241675400/0x3e099f5ef04ada67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3e099f5ef04ada6e expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.239064:0:7638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff8df241675400/0x3e099f5ef04ada67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3e099f5ef04ada6e expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.239157:0:7638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789760567.239195:0:7638:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df26cd8e800 10000000:01000000:3.0:1789760567.239202:0:7638:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789760567.239210:0:7638:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789760567.239213:0:7638:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789760567.239218:0:7638:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789760567.239230:0:7638:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789760567.239264:0:7638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241675a00/0x3e099f5ef04ada75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.239273:0:7638:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8df241675a00/0x3e099f5ef04ada75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.239285:0:7638:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8df241675a00/0x3e099f5ef04ada75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760567.239303:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882994688:0@lo:101: 00000100:00100000:3.0:1789760567.239347:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760567.239394:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259abf240 going to sleep for 11 seconds 00000100:00100000:1.0:1789760567.240309:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882994688 00000100:00100000:1.0:1789760567.240321:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882994688 00000100:00100000:1.0:1789760567.240402:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789760567.240412:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+12:7638:x1876699882994688:12345-0@lo:101: 00010000:00010000:1.0:1789760567.240432:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760567.240452:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241487600/0x3e099f5ef04ada7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04ada75 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760567.240484:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241487600/0x3e099f5ef04ada7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04ada75 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760567.240497:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241487600/0x3e099f5ef04ada7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ada75 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760567.240508:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241487600, rc 0) 00000100:00100000:1.0:1789760567.240587:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+13:7638:x1876699882994688:12345-0@lo:101: Request processed in 177us (1240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760567.240594:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789760567.241742:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882994688:0@lo:101: 00010000:00010000:3.0:1789760567.241771:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8df241675a00/0x3e099f5ef04ada75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ada7c expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.241784:0:7638:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8df241675a00/0x3e099f5ef04ada75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04ada7c expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760567.242041:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882994816:0@lo:501: 00000100:00100000:3.0:1789760567.242103:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760567.242265:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882994816 00000100:00100000:2.0:1789760567.242274:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882994816 00000100:00100000:2.0:1789760567.242320:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789760567.242329:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+13:7638:x1876699882994816:12345-0@lo:501: 00000100:00100000:2.0:1789760567.242640:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+13:7638:x1876699882994816:12345-0@lo:501: Request processed in 299us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760567.242649:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789760567.243679:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259abf240 going to sleep for 11 seconds 00000100:00100000:3.0:1789760567.243714:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882994816:0@lo:501: 00000100:00100000:3.0:1789760567.243766:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882994944:0@lo:503: 00000100:00100000:3.0:1789760567.243843:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760567.244182:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259abf240 going to sleep for 11 seconds 00010000:00010000:0.0:1789760567.244450:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789760567.244462:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8df241675400/0x3e099f5ef04ada67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x3e099f5ef04ada6e expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760567.244474:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241675400 already unused, calling callback (ffffffffc1be8c20) 10000000:00010000:0.0:1789760567.244479:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8df241675400/0x3e099f5ef04ada67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x3e099f5ef04ada6e expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760567.244492:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8df241675400/0x3e099f5ef04ada67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x3e099f5ef04ada6e expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760567.244501:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8df241675400/0x3e099f5ef04ada67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x3e099f5ef04ada6e expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760567.244507:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760567.244554:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8df241675400/0x3e099f5ef04ada67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3e099f5ef04ada6e expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760567.244561:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760567.244596:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8df241675400/0x3e099f5ef04ada67 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3e099f5ef04ada6e expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760567.244604:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8df241675400/0x3e099f5ef04ada67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3e099f5ef04ada6e expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760567.244643:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760567.244646:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760567.244648:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760567.244657:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789760567.244673:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258558e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699882995072:0@lo:103: 00000100:00100000:0.0:1789760567.244710:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760567.244742:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882995072 00000100:00100000:0.0:1789760567.244747:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882995072 00000100:00100000:0.0:1789760567.244796:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789760567.244836:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25855aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2780560-8e82-4256-94b0-2e524f3bed06+13:3310:x1876699882995072:12345-0@lo:103: 00010000:00010000:0.0:1789760567.244861:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760567.244879:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241539400/0x3e099f5ef04ada6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e099f5ef04ada67 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760567.244893:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760567.244923:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25855aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2780560-8e82-4256-94b0-2e524f3bed06+12:3310:x1876699882995072:12345-0@lo:103: Request processed in 89us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760567.244931:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789760567.244982:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258558e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699882995072:0@lo:103: 00000100:00100000:1.0:1789760567.246552:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882994944 00000100:00100000:1.0:1789760567.246564:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882994944 00000100:00100000:0.0:1789760567.246687:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789760567.246699:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+12:7638:x1876699882994944:12345-0@lo:503: 00000100:00100000:0.0:1789760567.247045:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+12:7638:x1876699882994944:12345-0@lo:503: Request processed in 346us (3201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760567.247054:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789760567.247650:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882994944:0@lo:503: 00000040:00080000:3.0:1789760567.248262:0:7638:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789760567.248380:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882995200:0@lo:502: 00000100:00100000:3.0:1789760567.248452:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760567.248513:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259abf240 going to sleep for 11 seconds 00000100:00100000:2.0:1789760567.248736:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882995200 00000100:00100000:2.0:1789760567.248746:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882995200 00000100:00100000:2.0:1789760567.248828:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789760567.248839:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+12:7638:x1876699882995200:12345-0@lo:502: 00000100:00100000:2.0:1789760567.249072:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+12:7638:x1876699882995200:12345-0@lo:502: Request processed in 235us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760567.249080:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789760567.249404:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882995200:0@lo:502: 00000040:00080000:3.0:1789760567.252275:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789760567.252393:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789760567.252423:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789760567.252468:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789760567.252499:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789760567.253499:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789760567.254121:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882995328:0@lo:502: 00000100:00100000:3.0:1789760567.254295:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760567.254390:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259abf240 going to sleep for 11 seconds 00000100:00100000:2.0:1789760567.255455:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882995328 00000100:00100000:2.0:1789760567.255468:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882995328 00000100:00100000:3.0:1789760567.256271:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789760567.256286:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+12:7638:x1876699882995328:12345-0@lo:502: 00000100:00100000:3.0:1789760567.257243:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+12:7638:x1876699882995328:12345-0@lo:502: Request processed in 957us (2944us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760567.257254:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789760567.257453:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882995328:0@lo:502: 00000040:00080000:1.0:1789760567.258982:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789760567.259005:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1789760567.263328:0:7648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789760567.263347:0:7648:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1789760567.263356:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760567.263360:0:7648:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789760567.263368:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789760567.263392:0:7648:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8df27456cd28) 00000020:00000080:3.0:1789760567.263425:0:7648:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789760567.263431:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789760567.263523:0:7648:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df26cd8e800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789760567.263550:0:7648:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789760567.263558:0:7648:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3e099f5ef04ada8a 00010000:00010000:3.0:1789760567.271041:0:7648:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1789760567.271501:0:7648:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1789760567.278323:0:7648:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1789760567.280369:0:7648:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1789760567.291524:0:7648:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1789760567.296533:0:7648:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1789760567.306919:0:7648:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789760567.306936:0:7648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760567.306946:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760567.306949:0:7648:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789760567.306954:0:7648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789760567.306960:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760567.306962:0:7648:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789760567.306965:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789760567.306967:0:7648:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789760567.307049:0:7648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760567.307053:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760567.307054:0:7648:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789760567.307058:0:7648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789760567.308234:0:7638:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1789760567.308282:0:7638:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789760567.308313:0:7638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241675a00/0x3e099f5ef04ada75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ada7c expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.308329:0:7638:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8df241675a00/0x3e099f5ef04ada75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ada7c expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760567.308341:0:7638:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df26cd8e800 from 1 10000000:01000000:3.0:1789760567.308344:0:7638:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789760567.308400:0:7638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241674e00/0x3e099f5ef04ada91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.308409:0:7638:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8df241674e00/0x3e099f5ef04ada91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.308423:0:7638:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8df241674e00/0x3e099f5ef04ada91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760567.308457:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882995456:0@lo:101: 00000100:00100000:3.0:1789760567.308571:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760567.308651:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259abf540 going to sleep for 11 seconds 00000100:00100000:0.0:1789760567.310166:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882995456 00000100:00100000:0.0:1789760567.310186:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882995456 00000100:00100000:0.0:1789760567.310267:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789760567.310279:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247886850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+12:7638:x1876699882995456:12345-0@lo:101: 00010000:00010000:0.0:1789760567.310301:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760567.310325:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df243a66a00/0x3e099f5ef04ada98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04ada91 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760567.310361:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df243a66a00/0x3e099f5ef04ada98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04ada91 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760567.310374:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df243a66a00/0x3e099f5ef04ada98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ada91 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760567.310384:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df243a66a00, rc 0) 00000100:00100000:0.0:1789760567.310485:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247886850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+13:7638:x1876699882995456:12345-0@lo:101: Request processed in 208us (1914us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760567.310507:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789760567.310584:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882995456:0@lo:101: 00010000:00010000:0.0:1789760567.310605:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8df241674e00/0x3e099f5ef04ada91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ada98 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760567.310616:0:7638:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8df241674e00/0x3e099f5ef04ada91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04ada98 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760567.310793:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258558e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882995584:0@lo:501: 00000100:00100000:0.0:1789760567.311164:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760567.311252:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df2586ca780 going to sleep for 11 seconds 00000100:00100000:3.0:1789760567.311587:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882995584 00000100:00100000:3.0:1789760567.311596:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882995584 00000100:00100000:3.0:1789760567.311663:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789760567.311681:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247885c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+13:7638:x1876699882995584:12345-0@lo:501: 00000100:00100000:3.0:1789760567.312109:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247885c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+13:7638:x1876699882995584:12345-0@lo:501: Request processed in 429us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760567.312118:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789760567.312378:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258558e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882995584:0@lo:501: 00000100:00100000:0.0:1789760567.312432:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258558e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882995712:0@lo:503: 00000100:00100000:0.0:1789760567.312486:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760567.312518:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df2586ca780 going to sleep for 11 seconds 00000100:00100000:3.0:1789760567.313070:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882995712 00000100:00100000:3.0:1789760567.313077:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882995712 00000100:00100000:3.0:1789760567.313129:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789760567.313139:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247884050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+13:7638:x1876699882995712:12345-0@lo:503: 00000100:00100000:0.0:1789760567.313828:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258558e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882995712:0@lo:503: 00000040:00080000:0.0:1789760567.314223:0:7638:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789760567.314318:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258558e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882995840:0@lo:502: 00000100:00100000:0.0:1789760567.314377:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760567.314421:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882995840 00000100:00100000:0.0:1789760567.314427:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882995840 00000100:00100000:0.0:1789760567.314461:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789760567.314469:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+14:7638:x1876699882995840:12345-0@lo:502: 00000100:00100000:0.0:1789760567.314978:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+14:7638:x1876699882995840:12345-0@lo:502: Request processed in 507us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760567.314998:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789760567.315075:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df2586ca780 going to sleep for 11 seconds 00000100:00100000:0.0:1789760567.315095:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258558e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882995840:0@lo:502: 00000040:00080000:0.0:1789760567.315378:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789760567.315432:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789760567.315462:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258558e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882995968:0@lo:502: 00000100:00100000:0.0:1789760567.315512:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760567.315543:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882995968 00000100:00100000:0.0:1789760567.315548:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882995968 00000100:00100000:0.0:1789760567.315577:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789760567.315584:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247886450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+14:7638:x1876699882995968:12345-0@lo:502: 00000100:00100000:3.0:1789760567.316025:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247884050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+14:7638:x1876699882995712:12345-0@lo:503: Request processed in 2885us (3536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760567.316035:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789760567.317527:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247886450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+13:7638:x1876699882995968:12345-0@lo:502: Request processed in 1932us (2004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760567.317539:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789760567.317643:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df2586ca780 going to sleep for 11 seconds 00000100:00100000:0.0:1789760567.317992:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258558e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882995968:0@lo:502: 00000040:00080000:0.0:1789760567.318178:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789760567.318196:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789760567.322323:0:7652:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789760567.322344:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760567.322347:0:7652:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789760567.322357:0:7652:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df26cd8e800 00000020:00000080:2.0:1789760567.322360:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789760567.325089:0:7652:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789760567.325107:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760567.325110:0:7652:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789760567.325117:0:7652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789760567.325554:0:7638:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789760567.325597:0:7638:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789760567.325645:0:7638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241674e00/0x3e099f5ef04ada91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ada98 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760567.325662:0:7638:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8df241674e00/0x3e099f5ef04ada91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04ada98 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760567.325952:0:7638:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789760567.325972:0:7638:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df26cd8e800 10000000:01000000:0.0:1789760567.325976:0:7638:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df26cd8e800 10000000:01000000:0.0:1789760567.325981:0:7638:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789760567.325989:0:7638:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df26cd8e800 from 1 10000000:01000000:0.0:1789760567.325992:0:7638:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789760567.326040:0:7638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df243a66800/0x3e099f5ef04ada9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760567.326050:0:7638:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8df243a66800/0x3e099f5ef04ada9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760567.326064:0:7638:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8df243a66800/0x3e099f5ef04ada9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760567.326098:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258558e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882996096:0@lo:101: 00000100:00100000:0.0:1789760567.326194:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760567.326250:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df2586ca840 going to sleep for 11 seconds 00000100:00100000:3.0:1789760567.326450:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882996096 00000100:00100000:3.0:1789760567.326461:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882996096 00000100:00100000:3.0:1789760567.326516:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789760567.326526:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+13:7638:x1876699882996096:12345-0@lo:101: 00010000:00010000:3.0:1789760567.326553:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760567.326569:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241674200/0x3e099f5ef04adaa6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04ada9f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.326604:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241674200/0x3e099f5ef04adaa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04ada9f expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.326618:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241674200/0x3e099f5ef04adaa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ada9f expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.326639:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241674200, rc 0) 00000100:00100000:3.0:1789760567.326693:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+14:7638:x1876699882996096:12345-0@lo:101: Request processed in 168us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760567.326700:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789760567.327474:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258558e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882996096:0@lo:101: 00010000:00010000:0.0:1789760567.327497:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8df243a66800/0x3e099f5ef04ada9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adaa6 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760567.327508:0:7638:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8df243a66800/0x3e099f5ef04ada9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04adaa6 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760567.327715:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258558e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882996224:0@lo:501: 00000100:00100000:2.0:1789760567.333098:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760567.333167:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df2586ca840 going to sleep for 11 seconds 00000100:00100000:3.0:1789760567.333994:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882996224 00000100:00100000:3.0:1789760567.334007:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882996224 00000100:00100000:3.0:1789760567.334072:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789760567.334083:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247886c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+14:7638:x1876699882996224:12345-0@lo:501: 00000100:00100000:3.0:1789760567.334461:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247886c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+14:7638:x1876699882996224:12345-0@lo:501: Request processed in 377us (1372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760567.334470:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789760567.334852:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258558e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882996224:0@lo:501: 00000100:00100000:0.0:1789760567.334919:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258558e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882996352:0@lo:503: 00000100:00100000:0.0:1789760567.334978:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760567.335027:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df2586ca840 going to sleep for 11 seconds 00000100:00100000:3.0:1789760567.339965:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882996352 00000100:00100000:3.0:1789760567.339988:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882996352 00000100:00100000:3.0:1789760567.340083:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789760567.340108:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247887050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+14:7638:x1876699882996352:12345-0@lo:503: 00000100:00100000:3.0:1789760567.340475:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247887050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+14:7638:x1876699882996352:12345-0@lo:503: Request processed in 370us (5495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760567.340484:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789760567.340560:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258558e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882996352:0@lo:503: 00000040:00080000:0.0:1789760567.341152:0:7638:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789760567.341262:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258558e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882996480:0@lo:502: 00000100:00100000:0.0:1789760567.341333:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760567.341382:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df2586ca840 going to sleep for 11 seconds 00000100:00100000:3.0:1789760567.341481:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882996480 00000100:00100000:3.0:1789760567.341488:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882996480 00000100:00100000:3.0:1789760567.341535:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789760567.341545:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247885450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+14:7638:x1876699882996480:12345-0@lo:502: 00000100:00100000:3.0:1789760567.341868:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247885450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+14:7638:x1876699882996480:12345-0@lo:502: Request processed in 323us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760567.341876:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789760567.342384:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258558e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882996480:0@lo:502: 00000040:00080000:1.0:1789760567.343004:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789760567.343084:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789760567.343419:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789760567.343479:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789760567.343528:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789760567.343688:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789760567.343995:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789760567.344043:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789760567.344088:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789760567.346997:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789760567.347117:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789760567.348946:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789760567.349054:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789760567.349609:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789760567.349694:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789760567.349729:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789760567.349886:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789760567.349929:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789760567.349959:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789760567.349989:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789760567.350047:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789760567.350078:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789760567.350282:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789760567.350327:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789760567.350357:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1789760567.350385:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1789760567.350451:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1789760567.350483:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1789760567.350635:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1789760567.350689:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1789760567.350720:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1789760567.350912:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1789760567.350945:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1789760567.350997:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1789760567.351029:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1789760567.351071:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1789760567.351258:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1789760567.351323:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c652680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882996608:0@lo:502: 00000100:00100000:1.0:1789760567.351429:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760567.351492:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df258fe63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760567.354560:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882996608 00000100:00100000:3.0:1789760567.354580:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882996608 00000100:00100000:3.0:1789760567.354697:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789760567.354710:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247887850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+14:7638:x1876699882996608:12345-0@lo:502: 00000100:00100000:3.0:1789760567.355132:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247887850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+14:7638:x1876699882996608:12345-0@lo:502: Request processed in 423us (3702us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760567.355169:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789760567.355263:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c652680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882996608:0@lo:502: 00000040:00080000:1.0:1789760567.355417:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1789760567.355439:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1789760567.361452:0:7653:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789760567.361504:0:7653:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8df26d420000) 00000020:00000080:1.0:1789760567.361534:0:7653:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1789760567.361679:0:7653:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df26cd8e800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789760567.361684:0:7653:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df26cd8e800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789760567.361687:0:7653:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df26cd8e800 3 00010000:00080000:1.0:1789760567.361987:0:7653:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df26d431800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1789760567.381273:0:7653:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1789760567.381589:0:7653:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789760567.381672:0:7653:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789760567.381692:0:7653:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x3e099f5ef04adab4 00000100:00080000:3.0:1789760567.381705:0:7653:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789760567.381712:0:7653:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8df26d431800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1789760567.381767:0:7653:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df2747f8e00 x1876699882996736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789760567.381797:0:7653:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:3.0:1789760567.382156:0:7653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:3.0:1789760567.382348:0:7654:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8df2747faa00 x1876699882996864/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760567.382358:0:7654:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259abf000 going to sleep for 0 seconds 00000100:00100000:1.0:1789760567.382445:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1876699882996736:0@lo:38: 00000100:00100000:1.0:1789760567.382544:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760567.382761:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25855b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1876699882997120:0@lo:400: 00000100:00100000:0.0:1789760567.382796:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760567.382851:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789760567.382858:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258558380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876699882996992:0@lo:400: 00000100:00100000:0.0:1789760567.382882:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760567.382907:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258558e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699882997248:0@lo:400: 00000100:00100000:0.0:1789760567.382936:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760567.382979:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882996736 00000100:00100000:0.0:1789760567.382986:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882996736 00000100:00100000:0.0:1789760567.383016:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882997120 00000100:00100000:0.0:1789760567.383018:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882997120 00000100:00100000:0.0:1789760567.383055:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882996992 00000100:00100000:0.0:1789760567.383058:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882996992 00000100:00100000:0.0:1789760567.383074:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789760567.383085:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876699882997120:12345-0@lo:400: 00000100:00100000:0.0:1789760567.383150:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876699882997120:12345-0@lo:400: Request processed in 65us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760567.383158:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789760567.383177:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789760567.383183:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876699882996992:12345-0@lo:400: 00000100:00100000:0.0:1789760567.383213:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876699882996992:12345-0@lo:400: Request processed in 29us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760567.383236:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789760567.383248:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789760567.383252:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1876699882996736:12345-0@lo:38: 00010000:00080000:0.0:1789760567.383276:0:5844:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:0.0:1789760567.383337:0:5844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x3e099f5ef04adabb 00000004:00100000:0.0:1789760567.383358:0:5844:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789760567.383397:0:5844:0:(import.c:65:import_set_state_nolock()) ffff8df251375000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789760567.383438:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876699882996736:12345-0@lo:38: Request processed in 183us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760567.383446:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789760567.383468:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882997248 00000100:00100000:0.0:1789760567.383472:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882997248 00000100:00100000:0.0:1789760567.383505:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789760567.383512:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699882997248:12345-0@lo:400: 00000100:00100000:0.0:1789760567.383550:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699882997248:12345-0@lo:400: Request processed in 39us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760567.383556:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789760567.383598:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df258558e00 x1876699882997248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760567.383612:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258558e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699882997248:0@lo:400: 00010000:00080000:0.0:1789760567.383652:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df258558380 x1876699882996992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760567.383661:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258558380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876699882996992:0@lo:400: 00010000:00080000:0.0:1789760567.383670:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df25855b800 x1876699882997120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760567.383689:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25855b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1876699882997120:0@lo:400: 00000100:00080000:1.0:1789760567.383795:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789760567.383821:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789760567.383845:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df2747f8e00 x1876699882996736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789760577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760567.383854:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789760567.383862:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1789760567.383872:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789760567.383878:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789760567.383881:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8df26d431800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1789760567.383887:0:3307:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000ad0a244f): req@ffff8df2747faa00 x1876699882996864/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760567.383908:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1876699882996736:0@lo:38: 00000100:00100000:0.0:1789760567.384268:0:7654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760567.384306:0:7654:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259abf000 going to sleep for 11 seconds 00000100:00100000:3.0:1789760567.387014:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882996864 00000100:00100000:3.0:1789760567.387035:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882996864 00000100:00100000:3.0:1789760567.387139:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789760567.387153:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25855b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7654:x1876699882996864:12345-0@lo:901: 00000100:00100000:3.0:1789760567.387973:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25855b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7654:x1876699882996864:12345-0@lo:901: Request processed in 820us (3702us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760567.387984:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789760567.388549:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789760567.388598:0:7654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df2747faa00 x1876699882996864/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789760583 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760567.388636:0:7654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747faa00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7654:1876699882996864:0@lo:901: 00000020:01000000:3.0:1789760567.391922:0:7638:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1789760567.391984:0:7638:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789760567.392022:0:7638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df243a66800/0x3e099f5ef04ada9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adaa6 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.392038:0:7638:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8df243a66800/0x3e099f5ef04ada9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adaa6 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789760567.392118:0:7638:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789760567.392121:0:7638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789760567.392123:0:7638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789760567.392124:0:7638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789760567.392126:0:7638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789760567.392127:0:7638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789760567.392129:0:7638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789760567.392131:0:7638:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789760567.392133:0:7638:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789760567.392135:0:7638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789760567.392137:0:7638:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789760567.392142:0:7638:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1789760567.392145:0:7638:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789760567.392147:0:7638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789760567.392148:0:7638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789760567.392150:0:7638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789760567.392151:0:7638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789760567.392152:0:7638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789760567.392153:0:7638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789760567.392154:0:7638:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789760567.392155:0:7638:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789760567.392156:0:7638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789760567.392157:0:7638:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789760567.392195:0:7638:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789760567.392221:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882997376:0@lo:253: 00000100:00100000:3.0:1789760567.392328:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760567.392388:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259abf780 going to sleep for 11 seconds 00000100:00100000:0.0:1789760567.392473:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882997376 00000100:00100000:0.0:1789760567.392483:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882997376 00000100:00100000:0.0:1789760567.392552:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789760567.392563:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247884c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+14:7638:x1876699882997376:12345-0@lo:253: 20000000:01000000:0.0:1789760567.392602:0:5837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789760567.392622:0:5837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789760567.475282:0:5837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789760567.475341:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789760567.491193:0:5860:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789760567.491208:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789760567.491249:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df241487400/0x3e099f5ef04adac2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760567.491298:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df241674600/0x3e099f5ef04ada05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ad9fe expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760567.491307:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df241487400/0x3e099f5ef04adac2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760567.491370:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df241674600/0x3e099f5ef04ada05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e099f5ef04ad9fe expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760567.491390:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df241674600/0x3e099f5ef04ada05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e099f5ef04ad9fe expref: 14 pid: 5839 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760567.491406:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c650000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1876699882997504:0@lo:104: 00000100:00100000:1.0:1789760567.491496:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760567.491568:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df258fe6600 going to sleep for 11 seconds 00000100:00100000:2.0:1789760567.492278:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882997504 00000100:00100000:2.0:1789760567.492303:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882997504 00000100:00100000:2.0:1789760567.492383:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789760567.492394:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c652d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e2780560-8e82-4256-94b0-2e524f3bed06+3:5860:x1876699882997504:12345-0@lo:104: 00010000:00010000:2.0:1789760567.492414:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8df243a67800/0x3e099f5ef04ad9fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ada05 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760567.492512:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789760567.492520:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c652d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e2780560-8e82-4256-94b0-2e524f3bed06+3:5860:x1876699882997504:12345-0@lo:104: Request processed in 127us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760567.492528:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1789760567.492556:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789760567.492564:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8df243a67800/0x3e099f5ef04ad9fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ada05 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760567.492572:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67800 already unused, calling callback (ffffffffc1be8c20) 10000000:00010000:2.0:1789760567.492577:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8df243a67800/0x3e099f5ef04ad9fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e099f5ef04ada05 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760567.492586:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8df243a67800/0x3e099f5ef04ad9fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e099f5ef04ada05 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789760567.492594:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8df243a67800/0x3e099f5ef04ad9fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e099f5ef04ada05 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760567.492600:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789760567.492660:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8df243a67800/0x3e099f5ef04ad9fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ada05 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760567.492668:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789760567.492972:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8df243a67800/0x3e099f5ef04ad9fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ada05 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760567.493214:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8df243a67800/0x3e099f5ef04ad9fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ada05 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760567.493240:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760567.493242:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760567.493245:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760567.493267:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699882997632:0@lo:103: 00000100:00100000:2.0:1789760567.493318:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760567.493461:0:7645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882997632 00000100:00100000:1.0:1789760567.493467:0:7645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882997632 00010000:00010000:1.0:1789760567.493499:0:7645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df241674600/0x3e099f5ef04ada05 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ad9fe expref: 15 pid: 5839 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760567.493536:0:7645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789760567.493547:0:7645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df260391850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2780560-8e82-4256-94b0-2e524f3bed06+15:3311:x1876699882997632:12345-0@lo:103: 00010000:00010000:1.0:1789760567.493560:0:7645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760567.493567:0:7645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df241674600/0x3e099f5ef04ada05 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ad9fe expref: 15 pid: 5839 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760567.493578:0:7645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df241674600/0x3e099f5ef04ada05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e099f5ef04ad9fe expref: 15 pid: 5839 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760567.493637:0:7645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df241487400/0x3e099f5ef04adac2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760567.493646:0:7645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241487400/0x3e099f5ef04adac2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789760567.493666:0:7645:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002806150s 00010000:00010000:1.0:1789760567.493671:0:7645:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df241487400/0x3e099f5ef04adac2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760567.493678:0:7645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df241487400/0x3e099f5ef04adac2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760567.493684:0:7645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df241487400/0x3e099f5ef04adac2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760567.496445:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df241487400/0x3e099f5ef04adac2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760567.496453:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241487400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760567.496458:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df241487400/0x3e099f5ef04adac2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760567.496470:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df241487400/0x3e099f5ef04adac2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760567.496492:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df241487400/0x3e099f5ef04adac2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760567.496512:0:7645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760567.496646:0:7645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df260391850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2780560-8e82-4256-94b0-2e524f3bed06+15:3311:x1876699882997632:12345-0@lo:103: Request processed in 3096us (3321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760567.496686:0:7645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1789760567.497009:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241674600/0x3e099f5ef04ada05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e099f5ef04ad9fe expref: 14 pid: 5839 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760567.497028:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c650000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1876699882997504:0@lo:104: 00010000:00010000:3.0:1789760567.497054:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df241487400/0x3e099f5ef04adac2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.497077:0:5860:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df241487400/0x3e099f5ef04adac2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.497084:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df241487400/0x3e099f5ef04adac2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760567.497091:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241487400/0x3e099f5ef04adac2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760567.497411:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699882997632:0@lo:103: 00010000:00010000:1.0:1789760567.507888:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760567.512496:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247884c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+13:7638:x1876699882997376:12345-0@lo:253: Request processed in 119918us (120152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760567.512516:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789760567.512706:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e2780560-8e82-4256-94b0-2e524f3bed06:7638:1876699882997376:0@lo:253: 10000000:01000000:2.0:1789760567.512736:0:7638:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789760567.512741:0:7638:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789760567.512743:0:7638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789760567.512744:0:7638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789760567.512746:0:7638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789760567.512747:0:7638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789760567.512749:0:7638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789760567.512750:0:7638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789760567.512752:0:7638:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789760567.512753:0:7638:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789760567.512755:0:7638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789760567.512756:0:7638:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789760567.512777:0:7638:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789760567.523096:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789760567.523467:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789760567.525187:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789760567.525456:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789760567.529402:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789760567.529776:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789760567.549248:0:7638:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789760568.114242:0:7638:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789760568.114253:0:7638:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789760568.114313:0:7638:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789760568.114392:0:7638:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789760568.114410:0:7638:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789760568.114444:0:7638:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1789760568.529888:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760569.551300:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760570.579142:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760570.959039:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699882997760:0@lo:13: 00000100:00100000:1.0:1789760570.959144:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760570.959341:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882997760 00000100:00100000:2.0:1789760570.959352:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882997760 00000100:00080000:0.0:1789760570.959466:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760570.959598:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789760570.959620:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c650380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699882997760:12345-0@lo:13: 00002000:00000024:2.0:1789760570.959676:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760570.959757:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c650380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699882997760:12345-0@lo:13: Request processed in 139us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760570.959765:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789760570.959848:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27d0ece00 x1876699882997760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760570.959872:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699882997760:0@lo:13: 00010000:00010000:0.0:1789760571.599618:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760572.496488:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699882998272:0@lo:400: 00000100:00100000:1.0:1789760572.496587:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760572.496958:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e2780560-8e82-4256-94b0-2e524f3bed06:3309:1876699882997888:0@lo:400: 00000100:00100000:0.0:1789760572.497003:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760572.497037:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1876699882998400:0@lo:400: 00000100:00100000:0.0:1789760572.497087:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760572.497126:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882998400 00000100:00100000:0.0:1789760572.497136:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882998400 00000100:00100000:0.0:1789760572.497207:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789760572.497218:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258558380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876699882998400:12345-0@lo:400: 00000100:00100000:0.0:1789760572.497299:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258558380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876699882998400:12345-0@lo:400: Request processed in 81us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760572.497307:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1789760572.497333:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789760572.497365:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27c652300 x1876699882998400/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760572.497381:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1876699882998400:0@lo:400: 00000100:00100000:3.0:1789760572.497488:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882997888 00000100:00100000:3.0:1789760572.497494:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882997888 00000100:00100000:3.0:1789760572.497531:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789760572.497538:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247885050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+13:3309:x1876699882997888:12345-0@lo:400: 00000100:00100000:3.0:1789760572.497580:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247885050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+13:3309:x1876699882997888:12345-0@lo:400: Request processed in 43us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760572.497585:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789760572.497645:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e2780560-8e82-4256-94b0-2e524f3bed06:3309:1876699882997888:0@lo:400: 00000100:00100000:2.0:1789760572.497989:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876699882998016:0@lo:400: 00000100:00100000:2.0:1789760572.498028:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760572.498054:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789760572.498060:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c652a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1876699882998144:0@lo:400: 00000100:00100000:2.0:1789760572.498082:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1789760572.498115:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789760572.498120:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df2598cf000 from 30 10000000:01000000:2.0:1789760572.498124:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789760572.498162:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241539a00/0x3e099f5ef04adac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760572.498174:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8df241539a00/0x3e099f5ef04adac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760572.498186:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8df241539a00/0x3e099f5ef04adac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760572.498204:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882998528:0@lo:101: 00000100:00100000:1.0:1789760572.498389:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882998272 00000100:00100000:1.0:1789760572.498396:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882998272 00000100:00100000:1.0:1789760572.498455:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789760572.498464:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c650000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699882998272:12345-0@lo:400: 00000100:00100000:1.0:1789760572.498516:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c650000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699882998272:12345-0@lo:400: Request processed in 53us (1929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760572.498523:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789760572.498547:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882998016 00000100:00100000:1.0:1789760572.498551:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882998016 00000100:00100000:1.0:1789760572.498573:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882998144 00000100:00100000:1.0:1789760572.498577:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882998144 00000100:00100000:1.0:1789760572.498606:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789760572.498613:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876699882998016:12345-0@lo:400: 00000100:00100000:1.0:1789760572.498649:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876699882998016:12345-0@lo:400: Request processed in 37us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760572.498656:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789760572.498667:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789760572.498673:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876699882998144:12345-0@lo:400: 00000100:00100000:1.0:1789760572.498700:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876699882998144:12345-0@lo:400: Request processed in 27us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760572.498715:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1789760572.498760:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27c651500 x1876699882998272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760572.498774:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699882998272:0@lo:400: 00000100:00080000:0.0:1789760572.498920:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789760572.498925:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760572.499179:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760572.499220:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df251361900 going to sleep for 11 seconds 00010000:00080000:2.0:1789760572.499256:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27c652a00 x1876699882998144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760572.499267:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c652a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1876699882998144:0@lo:400: 00010000:00080000:2.0:1789760572.499278:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27c653480 x1876699882998016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760572.499287:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876699882998016:0@lo:400: 00000100:00100000:0.0:1789760572.499309:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882998528 00000100:00100000:0.0:1789760572.499315:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882998528 00000100:00100000:0.0:1789760572.499355:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789760572.499363:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+13:5842:x1876699882998528:12345-0@lo:101: 00010000:00010000:0.0:1789760572.499375:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760572.499394:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df243a66400/0x3e099f5ef04adad0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04adac9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760572.499420:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df243a66400/0x3e099f5ef04adad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04adac9 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760572.499432:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df243a66400/0x3e099f5ef04adad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04adac9 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760572.499453:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df243a66400, rc 0) 00000100:00100000:0.0:1789760572.499492:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+14:5842:x1876699882998528:12345-0@lo:101: Request processed in 129us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760572.499497:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789760572.499505:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882998528:0@lo:101: 00010000:00010000:2.0:1789760572.499519:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8df241539a00/0x3e099f5ef04adac9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adad0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760572.499530:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8df241539a00/0x3e099f5ef04adac9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04adad0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760572.499602:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882998656:0@lo:501: 00000100:00100000:2.0:1789760572.499628:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760572.499651:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df251361900 going to sleep for 11 seconds 00000100:00100000:0.0:1789760572.499679:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882998656 00000100:00100000:0.0:1789760572.499683:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882998656 00000100:00100000:0.0:1789760572.499705:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789760572.499711:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247885850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+14:5842:x1876699882998656:12345-0@lo:501: 00000100:00100000:0.0:1789760572.500166:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247885850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+14:5842:x1876699882998656:12345-0@lo:501: Request processed in 453us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760572.500173:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789760572.503699:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882998656:0@lo:501: 00000100:00100000:2.0:1789760572.503786:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882998784:0@lo:503: 00000100:00100000:2.0:1789760572.506911:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760572.506980:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df251361900 going to sleep for 11 seconds 00000100:00100000:3.0:1789760572.508528:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882998784 00000100:00100000:3.0:1789760572.508545:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882998784 00000100:00100000:3.0:1789760572.508639:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789760572.508650:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+14:5842:x1876699882998784:12345-0@lo:503: 00000100:00100000:3.0:1789760572.509541:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+14:5842:x1876699882998784:12345-0@lo:503: Request processed in 888us (2636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760572.509563:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789760572.509875:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882998784:0@lo:503: 00000100:00100000:0.0:1789760572.511114:0:7827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258558e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:7827:1876699882998912:0@lo:502: 00000100:00100000:0.0:1789760572.511199:0:7827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760572.517358:0:7827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df251e69c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789760572.517689:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882998912 00000100:00100000:2.0:1789760572.517722:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882998912 00000100:00100000:2.0:1789760572.517784:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789760572.517795:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+14:7827:x1876699882998912:12345-0@lo:502: 00000100:00100000:2.0:1789760572.518260:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+14:7827:x1876699882998912:12345-0@lo:502: Request processed in 465us (7059us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760572.518269:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789760572.519129:0:7827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258558e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:7827:1876699882998912:0@lo:502: 00000100:00100000:0.0:1789760572.519219:0:7827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258558e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:7827:1876699882999040:0@lo:502: 00000100:00100000:0.0:1789760572.519290:0:7827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760572.519329:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882999040 00000100:00100000:0.0:1789760572.519334:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882999040 00000100:00100000:0.0:1789760572.519368:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789760572.519376:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+14:7827:x1876699882999040:12345-0@lo:502: 00000100:00100000:0.0:1789760572.519587:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+14:7827:x1876699882999040:12345-0@lo:502: Request processed in 210us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760572.519607:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789760572.520793:0:7827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259abf240 going to sleep for 11 seconds 00000100:00100000:0.0:1789760572.529431:0:7827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258558e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:7827:1876699882999040:0@lo:502: 00000040:00080000:0.0:1789760572.529506:0:7827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789760572.529621:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789760572.529646:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789760572.529661:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241539a00/0x3e099f5ef04adac9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adad0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760572.529673:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8df241539a00/0x3e099f5ef04adac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adad0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760572.529686:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789760572.529689:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1789760572.529692:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789760572.529737:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241486200/0x3e099f5ef04adad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760572.529746:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8df241486200/0x3e099f5ef04adad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760572.529758:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8df241486200/0x3e099f5ef04adad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760572.529782:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c651500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882999168:0@lo:101: 00000100:00100000:1.0:1789760572.530517:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760572.531442:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df260088000 going to sleep for 11 seconds 00000100:00100000:3.0:1789760572.534714:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882999168 00000100:00100000:3.0:1789760572.534735:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882999168 00000100:00100000:3.0:1789760572.534835:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789760572.534848:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+14:5842:x1876699882999168:12345-0@lo:101: 00010000:00010000:3.0:1789760572.534871:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760572.534896:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241674600/0x3e099f5ef04adade lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04adad7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760572.534936:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241674600/0x3e099f5ef04adade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04adad7 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760572.534951:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241674600/0x3e099f5ef04adade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04adad7 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760572.534961:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241674600, rc 0) 00000100:00100000:3.0:1789760572.535062:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+15:5842:x1876699882999168:12345-0@lo:101: Request processed in 218us (4549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760572.535070:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789760572.535140:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c651500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882999168:0@lo:101: 00010000:00010000:3.0:1789760572.535161:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8df241486200/0x3e099f5ef04adad7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adade expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760572.535173:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8df241486200/0x3e099f5ef04adad7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04adade expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760572.535266:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882999296:0@lo:501: 00000100:00100000:3.0:1789760572.535324:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760572.535362:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df2598f7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789760572.535379:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882999296 00000100:00100000:3.0:1789760572.535383:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882999296 00000100:00100000:3.0:1789760572.535408:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789760572.535415:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+15:5842:x1876699882999296:12345-0@lo:501: 00000100:00100000:3.0:1789760572.535771:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+15:5842:x1876699882999296:12345-0@lo:501: Request processed in 354us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760572.535779:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789760572.535963:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882999296:0@lo:501: 00000100:00100000:0.0:1789760572.536002:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258558e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882999424:0@lo:503: 00000100:00100000:0.0:1789760572.536051:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760572.536179:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df247439300 going to sleep for 11 seconds 00000100:00100000:3.0:1789760572.536717:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882999424 00000100:00100000:3.0:1789760572.536725:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882999424 00000100:00100000:3.0:1789760572.537602:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789760572.537622:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+15:5842:x1876699882999424:12345-0@lo:503: 00000100:00100000:3.0:1789760572.539068:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+15:5842:x1876699882999424:12345-0@lo:503: Request processed in 1444us (3006us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760572.539082:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789760572.541201:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258558e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882999424:0@lo:503: 00000100:00100000:0.0:1789760572.545128:0:7831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258559f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:7831:1876699882999552:0@lo:502: 00000100:00100000:0.0:1789760572.545251:0:7831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760572.545431:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882999552 00000100:00100000:3.0:1789760572.545440:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882999552 00000100:00100000:0.0:1789760572.546735:0:7831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df2598f7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789760572.553413:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789760572.553436:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+15:7831:x1876699882999552:12345-0@lo:502: 00000100:00100000:2.0:1789760572.554091:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+15:7831:x1876699882999552:12345-0@lo:502: Request processed in 657us (8837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760572.554101:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789760572.555571:0:7831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258559f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:7831:1876699882999552:0@lo:502: 00000020:01000000:0.0:1789760572.555648:0:7831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789760572.555662:0:7831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760572.555665:0:7831:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789760572.555674:0:7831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789760572.555676:0:7831:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789760572.555716:0:7831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258559f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:7831:1876699882999680:0@lo:502: 00000100:00100000:0.0:1789760572.555820:0:7831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760572.555884:0:7831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259abf240 going to sleep for 11 seconds 00000100:00100000:2.0:1789760572.557722:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882999680 00000100:00100000:2.0:1789760572.557741:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882999680 00000100:00100000:2.0:1789760572.558099:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789760572.558112:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+15:7831:x1876699882999680:12345-0@lo:502: 00000100:00100000:2.0:1789760572.559252:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+15:7831:x1876699882999680:12345-0@lo:502: Request processed in 1135us (3441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760572.559264:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789760572.559551:0:7831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258559f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:7831:1876699882999680:0@lo:502: 00000020:01000000:0.0:1789760572.559610:0:7831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760572.559619:0:7831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760572.559621:0:7831:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789760572.559636:0:7831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1789760572.560078:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1789760572.560111:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789760572.560123:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241486200/0x3e099f5ef04adad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adade expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760572.560136:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8df241486200/0x3e099f5ef04adad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adade expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760572.560159:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789760572.560162:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df2457ba800 from 30 10000000:01000000:2.0:1789760572.560165:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789760572.560202:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241538600/0x3e099f5ef04adae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760572.560211:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8df241538600/0x3e099f5ef04adae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760572.560221:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8df241538600/0x3e099f5ef04adae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760572.560243:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882999808:0@lo:101: 00000100:00100000:2.0:1789760572.560297:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760572.560963:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882999808 00000100:00100000:0.0:1789760572.560972:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882999808 00000100:00100000:0.0:1789760572.561026:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789760572.561042:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+15:5842:x1876699882999808:12345-0@lo:101: 00010000:00010000:0.0:1789760572.561058:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760572.561072:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df243a67800/0x3e099f5ef04adaec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04adae5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760572.561098:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df243a67800/0x3e099f5ef04adaec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04adae5 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760572.561108:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df243a67800/0x3e099f5ef04adaec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04adae5 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760572.561117:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df243a67800, rc 0) 00000100:00100000:0.0:1789760572.561159:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+16:5842:x1876699882999808:12345-0@lo:101: Request processed in 119us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760572.561166:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789760572.561458:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df251361c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789760572.561483:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882999808:0@lo:101: 00010000:00010000:2.0:1789760572.561499:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8df241538600/0x3e099f5ef04adae5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adaec expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760572.561509:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8df241538600/0x3e099f5ef04adae5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04adaec expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760572.561572:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882999936:0@lo:501: 00000100:00100000:2.0:1789760572.561614:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760572.561629:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df251361c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789760572.561646:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699882999936 00000100:00100000:2.0:1789760572.561649:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699882999936 00000100:00100000:2.0:1789760572.561680:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789760572.561695:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+16:5842:x1876699882999936:12345-0@lo:501: 00000100:00100000:2.0:1789760572.562690:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+16:5842:x1876699882999936:12345-0@lo:501: Request processed in 991us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760572.562700:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789760572.563342:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699882999936:0@lo:501: 00000100:00100000:3.0:1789760572.563404:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883000064:0@lo:503: 00000100:00100000:3.0:1789760572.563472:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760572.563554:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df243c2c780 going to sleep for 11 seconds 00000100:00100000:1.0:1789760572.563605:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883000064 00000100:00100000:1.0:1789760572.563618:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883000064 00000100:00100000:1.0:1789760572.563705:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789760572.563714:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+16:5842:x1876699883000064:12345-0@lo:503: 00000100:00100000:1.0:1789760572.564130:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+16:5842:x1876699883000064:12345-0@lo:503: Request processed in 415us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760572.564139:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789760572.564224:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883000064:0@lo:503: 00000100:00100000:3.0:1789760572.564420:0:7834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747f9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:7834:1876699883000192:0@lo:502: 00000100:00100000:3.0:1789760572.564460:0:7834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760572.564575:0:7834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df243c2c600 going to sleep for 11 seconds 00000100:00100000:2.0:1789760572.564647:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883000192 00000100:00100000:2.0:1789760572.564653:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883000192 00000100:00100000:2.0:1789760572.564679:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789760572.564687:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+16:7834:x1876699883000192:12345-0@lo:502: 00000100:00100000:2.0:1789760572.565019:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+16:7834:x1876699883000192:12345-0@lo:502: Request processed in 332us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760572.565027:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789760572.565268:0:7834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747f9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:7834:1876699883000192:0@lo:502: 00000100:00100000:3.0:1789760572.565327:0:7834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747f9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:7834:1876699883000320:0@lo:502: 00000100:00100000:3.0:1789760572.565364:0:7834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760572.565421:0:7834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df2482db780 going to sleep for 11 seconds 00000100:00100000:2.0:1789760572.565455:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883000320 00000100:00100000:2.0:1789760572.565459:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883000320 00000100:00100000:2.0:1789760572.565525:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789760572.565532:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+16:7834:x1876699883000320:12345-0@lo:502: 00000100:00100000:2.0:1789760572.565704:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+16:7834:x1876699883000320:12345-0@lo:502: Request processed in 172us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760572.565711:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789760572.565777:0:7834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747f9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:7834:1876699883000320:0@lo:502: 00000040:00080000:1.0:1789760572.565798:0:7834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789760572.566165:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789760572.566189:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789760572.566201:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241538600/0x3e099f5ef04adae5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adaec expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760572.566213:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8df241538600/0x3e099f5ef04adae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adaec expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760572.566223:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789760572.566226:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df2457ba800 from 5 10000000:01000000:3.0:1789760572.566229:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789760572.566262:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241675800/0x3e099f5ef04adaf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760572.566271:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8df241675800/0x3e099f5ef04adaf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760572.566282:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8df241675800/0x3e099f5ef04adaf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760572.566295:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883000448:0@lo:101: 00000100:00100000:3.0:1789760572.566328:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760572.566367:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df2482db780 going to sleep for 11 seconds 00000100:00100000:1.0:1789760572.566420:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883000448 00000100:00100000:1.0:1789760572.566425:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883000448 00000100:00100000:1.0:1789760572.566460:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789760572.566467:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+16:5842:x1876699883000448:12345-0@lo:101: 00010000:00010000:1.0:1789760572.566477:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760572.566493:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241486800/0x3e099f5ef04adafa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04adaf3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760572.566517:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241486800/0x3e099f5ef04adafa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04adaf3 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760572.566529:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241486800/0x3e099f5ef04adafa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04adaf3 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760572.566538:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241486800, rc 0) 00000100:00100000:1.0:1789760572.566571:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+17:5842:x1876699883000448:12345-0@lo:101: Request processed in 104us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760572.566577:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789760572.566660:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883000448:0@lo:101: 00010000:00010000:3.0:1789760572.566673:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8df241675800/0x3e099f5ef04adaf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adafa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760572.566689:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8df241675800/0x3e099f5ef04adaf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04adafa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760572.566734:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883000576:0@lo:256: 00000100:00100000:3.0:1789760572.566766:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760572.566786:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df2482db780 going to sleep for 11 seconds 00000100:00100000:3.0:1789760572.566923:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883000576 00000100:00100000:3.0:1789760572.566927:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883000576 00000100:00100000:3.0:1789760572.566950:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789760572.566956:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+17:5842:x1876699883000576:12345-0@lo:256: 20000000:01000000:3.0:1789760572.566971:0:5837:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789760572.566993:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789760572.566996:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1789760572.567080:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+17:5842:x1876699883000576:12345-0@lo:256: Request processed in 123us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760572.567086:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789760572.567115:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883000576:0@lo:256: 10000000:01000000:3.0:1789760572.567157:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789760572.567164:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241675800/0x3e099f5ef04adaf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adafa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760572.567172:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8df241675800/0x3e099f5ef04adaf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adafa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760572.567180:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789760572.567182:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1789760572.567184:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789760572.567209:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241675400/0x3e099f5ef04adb01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760572.567216:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8df241675400/0x3e099f5ef04adb01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760572.567224:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8df241675400/0x3e099f5ef04adb01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760572.567236:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883000704:0@lo:101: 00000100:00100000:3.0:1789760572.567263:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760572.567277:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df2482db780 going to sleep for 11 seconds 00000100:00100000:3.0:1789760572.567289:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883000704 00000100:00100000:3.0:1789760572.567292:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883000704 00000100:00100000:3.0:1789760572.567310:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789760572.567317:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+17:5842:x1876699883000704:12345-0@lo:101: 00010000:00010000:3.0:1789760572.567324:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760572.567333:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241674000/0x3e099f5ef04adb08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04adb01 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760572.567351:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241674000/0x3e099f5ef04adb08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04adb01 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760572.567359:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241674000/0x3e099f5ef04adb08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04adb01 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760572.567366:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241674000, rc 0) 00000100:00100000:3.0:1789760572.567393:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+18:5842:x1876699883000704:12345-0@lo:101: Request processed in 77us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760572.567399:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789760572.567433:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883000704:0@lo:101: 00010000:00010000:3.0:1789760572.567445:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8df241675400/0x3e099f5ef04adb01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adb08 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760572.567452:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8df241675400/0x3e099f5ef04adb01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04adb08 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760572.567503:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883000832:0@lo:501: 00000100:00100000:3.0:1789760572.567529:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760572.567542:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df27de56780 going to sleep for 11 seconds 00000100:00100000:3.0:1789760572.567553:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883000832 00000100:00100000:3.0:1789760572.567555:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883000832 00000100:00100000:3.0:1789760572.567573:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789760572.567578:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+18:5842:x1876699883000832:12345-0@lo:501: 00000100:00100000:3.0:1789760572.568214:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+18:5842:x1876699883000832:12345-0@lo:501: Request processed in 632us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760572.568223:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789760572.568415:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883000832:0@lo:501: 00000100:00100000:1.0:1789760572.568457:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c651180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883000960:0@lo:503: 00000100:00100000:1.0:1789760572.568512:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760572.568581:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df258e7d000 going to sleep for 11 seconds 00000100:00100000:2.0:1789760572.568625:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883000960 00000100:00100000:2.0:1789760572.568631:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883000960 00000100:00100000:2.0:1789760572.568709:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789760572.568717:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+18:5842:x1876699883000960:12345-0@lo:503: 00000100:00100000:2.0:1789760572.573372:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+18:5842:x1876699883000960:12345-0@lo:503: Request processed in 4642us (4845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760572.573391:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789760572.573506:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c651180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883000960:0@lo:503: 00000100:00100000:2.0:1789760572.576462:0:7835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:7835:1876699883001088:0@lo:502: 00000100:00100000:2.0:1789760572.576573:0:7835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760572.578164:0:7835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df251361900 going to sleep for 11 seconds 00000100:00100000:3.0:1789760572.578231:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883001088 00000100:00100000:3.0:1789760572.578243:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883001088 00000100:00100000:3.0:1789760572.578350:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789760572.578363:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247857c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+18:7835:x1876699883001088:12345-0@lo:502: 00000100:00100000:3.0:1789760572.579076:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247857c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+18:7835:x1876699883001088:12345-0@lo:502: Request processed in 712us (2498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760572.579087:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789760572.581763:0:7835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:7835:1876699883001088:0@lo:502: 00000020:01000000:1.0:1789760572.581960:0:7835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789760572.581970:0:7835:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789760572.581980:0:7835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760572.581983:0:7835:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789760572.581989:0:7835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789760572.581993:0:7835:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:1.0:1789760572.582028:0:7835:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789760572.582032:0:7835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789760572.582056:0:7835:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8df26d423370) 00000020:00000080:1.0:1789760572.582085:0:7835:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789760572.582092:0:7835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789760572.582202:0:7835:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789760572.582211:0:7835:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789760572.582220:0:7835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e099f5ef04adb16 00010000:00080000:1.0:1789760572.582259:0:7835:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df26d435800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1789760572.582547:0:7835:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1789760572.588388:0:7835:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1789760572.588416:0:7835:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789760572.590197:0:7835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789760572.590467:0:7835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789760572.590532:0:7835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1789760572.590616:0:7835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1789760572.596017:0:7837:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789760572.596027:0:7837:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789760572.599744:0:7835:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789760572.599767:0:7835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789760572.599836:0:7835:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789760572.599865:0:7835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e099f5ef04adb1d 00000100:00080000:0.0:1789760572.599879:0:7835:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789760572.599886:0:7835:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8df26d435800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1789760572.599934:0:7835:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df258559f80 x1876699883001216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789760572.599961:0:7835:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1789760572.600025:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258559f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1876699883001216:0@lo:8: 00000020:01000000:0.0:1789760572.600039:0:7835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760572.600043:0:7835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760572.600045:0:7835:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789760572.600056:0:7835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789760572.600060:0:7835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760572.600062:0:7835:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789760572.600065:0:7835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789760572.600067:0:7835:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789760572.600096:0:7835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25855ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:7835:1876699883001344:0@lo:502: 00000100:00100000:1.0:1789760572.600117:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760572.606224:0:7835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760572.606274:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883001216 00000100:00100000:1.0:1789760572.606288:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883001216 00000100:00100000:2.0:1789760572.606401:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883001344 00000100:00100000:2.0:1789760572.606406:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883001344 00000100:00100000:2.0:1789760572.606464:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789760572.606475:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247856450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+18:7835:x1876699883001344:12345-0@lo:502: 00000100:00100000:0.0:1789760572.606980:0:7835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259abf240 going to sleep for 11 seconds 00000100:00100000:2.0:1789760572.607142:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247856450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+18:7835:x1876699883001344:12345-0@lo:502: Request processed in 668us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760572.607152:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789760572.607534:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789760572.607542:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c650a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1876699883001216:12345-0@lo:8: 00010000:00080000:1.0:1789760572.607572:0:6694:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:1.0:1789760572.607690:0:6694:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e099f5ef04adb24 00002000:00100000:1.0:1789760572.607711:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8df2779e4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789760572.607716:0:6694:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1789760572.607721:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1789760572.608012:0:6694:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789760572.608207:0:6694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789760572.608243:0:6694:0:(import.c:65:import_set_state_nolock()) ffff8df1410cb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789760572.608406:0:7835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25855ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:7835:1876699883001344:0@lo:502: 00000020:01000000:0.0:1789760572.608460:0:7835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760572.608469:0:7835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760572.608472:0:7835:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789760572.608479:0:7835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:1.0:1789760572.608481:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c650a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1876699883001216:12345-0@lo:8: Request processed in 938us (8363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760572.608488:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789760572.608531:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df258559f80 x1876699883001216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789760582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760572.608544:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789760572.608552:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789760572.608561:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789760572.608567:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789760572.608569:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8df26d435800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789760572.608586:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000020:01000000:3.0:1789760572.608618:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1789760572.608653:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789760572.608679:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241675400/0x3e099f5ef04adb01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adb08 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760572.608702:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8df241675400/0x3e099f5ef04adb01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adb08 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760572.608715:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789760572.608718:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8df2598e3370 from 1 10000000:01000000:3.0:1789760572.608721:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789760572.608760:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241674c00/0x3e099f5ef04adb2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760572.608768:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8df241674c00/0x3e099f5ef04adb2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760572.608778:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8df241674c00/0x3e099f5ef04adb2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760572.608799:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747f9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883001472:0@lo:101: 00000004:00080000:0.0:1789760572.609196:0:7837:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1789760572.609422:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789760572.609432:0:7837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 176722628883ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789760572.609470:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df27de56780 going to sleep for 11 seconds 00000100:00100000:3.0:1789760572.609492:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883001472 00000100:00100000:3.0:1789760572.609499:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883001472 00000100:00100000:3.0:1789760572.609554:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789760572.609564:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247854850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+18:5842:x1876699883001472:12345-0@lo:101: 00010000:00010000:3.0:1789760572.609579:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760572.609611:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241675e00/0x3e099f5ef04adb32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04adb2b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760572.610040:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241675e00/0x3e099f5ef04adb32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04adb2b expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760572.610077:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241675e00/0x3e099f5ef04adb32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04adb2b expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760572.610089:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241675e00, rc 0) 00000100:00100000:3.0:1789760572.610146:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247854850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:5842:x1876699883001472:12345-0@lo:101: Request processed in 583us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760572.610154:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789760572.610409:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747f9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883001472:0@lo:101: 00010000:00010000:0.0:1789760572.610427:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8df241674c00/0x3e099f5ef04adb2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adb32 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760572.610438:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8df241674c00/0x3e099f5ef04adb2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04adb32 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760572.610516:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25855ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883001600:0@lo:501: 00000100:00100000:0.0:1789760572.610772:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760572.610783:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258559f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1876699883001216:0@lo:8: 00000100:00100000:0.0:1789760572.610844:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df27cdb4840 going to sleep for 11 seconds 00000100:00100000:3.0:1789760572.615421:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883001600 00000100:00100000:3.0:1789760572.615444:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883001600 00000100:00100000:3.0:1789760572.615520:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789760572.615531:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247856c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:5842:x1876699883001600:12345-0@lo:501: 00000100:00100000:3.0:1789760572.616129:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247856c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:5842:x1876699883001600:12345-0@lo:501: Request processed in 596us (5574us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789760572.616138:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789760572.616613:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25855ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883001600:0@lo:501: 10000000:01000000:3.0:1789760572.616723:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789760572.616737:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241674c00/0x3e099f5ef04adb2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adb32 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760572.616750:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8df241674c00/0x3e099f5ef04adb2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adb32 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760572.627524:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789760572.681611:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1789760572.737060:0:7838:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789760572.737104:0:7838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25855ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7838:1876699883001856:0@lo:7: 00000100:00100000:0.0:1789760572.737195:0:7838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760572.737272:0:7838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df2686c3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789760572.737310:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25855a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883001728:0@lo:13: 00000100:00100000:0.0:1789760572.737340:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760572.737778:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883001856 00000100:00100000:1.0:1789760572.737788:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883001856 00000100:00100000:1.0:1789760572.738033:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789760572.738053:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258559f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7838:x1876699883001856:12345-0@lo:7: 00000100:00080000:0.0:1789760572.738969:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789760572.744014:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883001728 00000100:00100000:2.0:1789760572.744031:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883001728 00000100:00100000:2.0:1789760572.744103:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789760572.744115:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258558e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1876699883001728:12345-0@lo:13: 00002000:00000024:2.0:1789760572.744158:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1789760572.744276:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258558e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1876699883001728:12345-0@lo:13: Request processed in 164us (6935us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760572.744285:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789760572.744561:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df25855a300 x1876699883001728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760588 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760572.744584:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25855a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883001728:0@lo:13: 00002000:00080000:1.0:1789760572.752735:0:6693:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1789760572.753502:0:6693:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789760572.757216:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258559f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7838:x1876699883001856:12345-0@lo:7: Request processed in 19150us (20005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760572.757237:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789760572.757606:0:7838:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df25855ad80 x1876699883001856/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789760588 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760572.757628:0:7838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25855ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7838:1876699883001856:0@lo:7: 00000004:00080000:0.0:1789760572.757649:0:7838:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789760572.757706:0:7838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25855ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7838:1876699883001984:0@lo:5: 00000100:00100000:0.0:1789760572.757776:0:7838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760572.758008:0:7838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df2686c3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789760572.759087:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883001984 00000100:00100000:1.0:1789760572.759101:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883001984 00000100:00100000:1.0:1789760572.759542:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789760572.759555:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25855a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7838:x1876699883001984:12345-0@lo:5: 00002000:00080000:1.0:1789760572.759608:0:6694:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789760572.759614:0:6694:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789760572.761838:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25855a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7838:x1876699883001984:12345-0@lo:5: Request processed in 2277us (4052us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789760572.761852:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789760572.762064:0:7838:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df25855ad80 x1876699883001984/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789760588 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760572.762084:0:7838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25855ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7838:1876699883001984:0@lo:5: 00000004:00080000:0.0:1789760572.762104:0:7838:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789760572.762158:0:7838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25855aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7838:1876699883002112:0@lo:700: 00000100:00100000:0.0:1789760572.762219:0:7838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760572.762272:0:7838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df2686c3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789760572.762340:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883002112 00000100:00100000:2.0:1789760572.762348:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883002112 00000100:00100000:2.0:1789760572.762402:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789760572.762421:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7838:x1876699883002112:12345-0@lo:700: 00000100:00100000:2.0:1789760572.762464:0:6701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6701:1876699883002240:0@lo:700: 00000100:00100000:2.0:1789760572.762502:0:6701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760572.762528:0:6701:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df251361e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789760572.762649:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883002240 00000100:00100000:0.0:1789760572.762654:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883002240 00000100:00100000:0.0:1789760572.762691:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789760572.762699:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6701:x1876699883002240:12345-0@lo:700: 40000000:02000000:0.0:1789760572.841547:0:5851:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1789760572.851688:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6701:x1876699883002240:12345-0@lo:700: Request processed in 88978us (89172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760572.851707:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789760572.852330:0:6701:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27d0ed500 x1876699883002240/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789760588 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760572.852349:0:6701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6701:1876699883002240:0@lo:700: 40000000:02000000:1.0:1789760572.852365:0:6701:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:1.0:1789760573.016669:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7838:x1876699883002112:12345-0@lo:700: Request processed in 254244us (254435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760573.016687:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:1.0:1789760573.016742:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1789760573.016755:0:7658:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:1.0:1789760573.017417:0:7838:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df25855aa00 x1876699883002112/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789760588 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760573.017439:0:7838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25855aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7838:1876699883002112:0@lo:700: 00000004:02000040:1.0:1789760573.100452:0:7838:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1789760573.107000:0:7838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ee300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7838:1876699883002368:0@lo:5: 00000100:00100000:2.0:1789760573.107117:0:7838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760573.107182:0:7838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df242e58540 going to sleep for 11 seconds 00000100:00100000:1.0:1789760573.107266:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883002368 00000100:00100000:1.0:1789760573.107277:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883002368 00000100:00100000:1.0:1789760573.107349:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789760573.107361:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7838:x1876699883002368:12345-0@lo:5: 00002000:00080000:1.0:1789760573.128618:0:6693:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1789760573.128646:0:6693:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1789760573.133333:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7838:x1876699883002368:12345-0@lo:5: Request processed in 25960us (26202us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789760573.133351:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789760573.133448:0:7838:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27d0ee300 x1876699883002368/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789760589 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760573.133466:0:7838:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789760573.133544:0:7838:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8df27d0ee300 x1876699883002368/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789760589 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760573.133556:0:7838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ee300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7838:1876699883002368:0@lo:5: 00000004:00080000:0.0:1789760573.133571:0:7838:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1789760573.649315:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760574.672760:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760575.696038:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760576.080843:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789760576.080875:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883002496:0@lo:13: 00000100:00100000:2.0:1789760576.080974:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760576.081070:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883002496 00000100:00100000:2.0:1789760576.081079:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883002496 00000100:00100000:2.0:1789760576.081143:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789760576.081153:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883002496:12345-0@lo:13: 00002000:00000024:2.0:1789760576.081199:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760576.081252:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883002496:12345-0@lo:13: Request processed in 100us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760576.081259:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1789760576.081284:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789760576.081323:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27d0ef100 x1876699883002496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760576.081344:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883002496:0@lo:13: 00000001:02000400:1.0:1789760576.097536:0:8005:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789760576.718986:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760577.616080:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1876699883002880:0@lo:400: 00000100:00100000:1.0:1789760577.616254:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760577.616334:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789760577.616342:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883003008:0@lo:400: 00000100:00100000:1.0:1789760577.616374:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760577.616424:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883002880 00000100:00100000:1.0:1789760577.616433:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883002880 00000100:00100000:1.0:1789760577.616507:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789760577.616520:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876699883002880:12345-0@lo:400: 00000100:00100000:1.0:1789760577.616604:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876699883002880:12345-0@lo:400: Request processed in 85us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760577.616613:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789760577.616641:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883003008 00000100:00100000:1.0:1789760577.616645:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883003008 00000100:00100000:1.0:1789760577.616675:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789760577.616683:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883003008:12345-0@lo:400: 00000100:00100000:1.0:1789760577.616718:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883003008:12345-0@lo:400: Request processed in 36us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760577.616724:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789760577.616749:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789760577.616793:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27c651180 x1876699883003008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760577.616837:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883003008:0@lo:400: 00010000:00080000:1.0:1789760577.616851:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27c651f80 x1876699883002880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760577.616860:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1876699883002880:0@lo:400: 00000100:00100000:3.0:1789760577.616963:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699883002624:0@lo:400: 00000100:00100000:3.0:1789760577.617095:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760577.617138:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1876699883003136:0@lo:400: 00000100:00100000:0.0:1789760577.618004:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876699883002752:0@lo:400: 00000100:00100000:0.0:1789760577.618062:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760577.618104:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883003264:0@lo:400: 00000100:00100000:3.0:1789760577.618119:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760577.618145:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760577.618190:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883002752 00000100:00100000:3.0:1789760577.618197:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883002752 00000100:00100000:3.0:1789760577.618241:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883003136 00000100:00100000:3.0:1789760577.618245:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883003136 00000100:00100000:3.0:1789760577.618280:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789760577.618292:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876699883002752:12345-0@lo:400: 00000100:00100000:3.0:1789760577.618358:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876699883002752:12345-0@lo:400: Request processed in 69us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760577.618366:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789760577.618385:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789760577.618391:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876699883003136:12345-0@lo:400: 00000100:00100000:3.0:1789760577.618426:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876699883003136:12345-0@lo:400: Request processed in 34us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760577.618433:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1789760577.618452:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27c650700 x1876699883002752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1789760577.618465:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27c651500 x1876699883003136/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760577.618468:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876699883002752:0@lo:400: 00000100:00100000:3.0:1789760577.618484:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1876699883003136:0@lo:400: 00000100:00100000:2.0:1789760577.618638:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883003264 00000100:00100000:2.0:1789760577.618643:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883003264 00000100:00100000:2.0:1789760577.618716:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789760577.618725:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1876699883003264:12345-0@lo:400: 00000100:00100000:2.0:1789760577.618776:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1876699883003264:12345-0@lo:400: Request processed in 52us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760577.618783:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789760577.618943:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883002624 00000100:00100000:1.0:1789760577.618948:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883002624 00000100:00100000:1.0:1789760577.619122:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789760577.619132:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247855450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3308:x1876699883002624:12345-0@lo:400: 00000100:00100000:1.0:1789760577.619188:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247855450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3308:x1876699883002624:12345-0@lo:400: Request processed in 58us (2093us total) trans 0 rc 0/0 00010000:00080000:2.0:1789760577.621725:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27c653480 x1876699883003264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760577.621783:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883003264:0@lo:400: 00000100:00080000:0.0:1789760577.622716:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789760577.622727:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760577.623210:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699883002624:0@lo:400: 00000100:00100000:1.0:1789760577.625930:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00010000:0.0:1789760577.743757:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760578.136125:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883003392:0@lo:13: 00000100:00100000:0.0:1789760578.136233:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760578.138681:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883003392 00000100:00100000:0.0:1789760578.138697:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883003392 00000100:00100000:0.0:1789760578.138770:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789760578.139965:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1876699883003392:12345-0@lo:13: 00002000:00000024:0.0:1789760578.140031:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760578.140149:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1876699883003392:12345-0@lo:13: Request processed in 198us (3916us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760578.140157:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789760578.140252:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26d716680 x1876699883003392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760594 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760578.140280:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883003392:0@lo:13: 00000001:00080000:1.0:1789760578.278125:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1789760578.767247:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760579.798225:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760580.815244:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760581.199173:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883003520:0@lo:13: 00000100:00100000:0.0:1789760581.199286:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760581.199454:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883003520 00000100:00100000:2.0:1789760581.199465:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883003520 00000100:00100000:2.0:1789760581.199647:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789760581.199659:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883003520:12345-0@lo:13: 00002000:00000024:2.0:1789760581.199708:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760581.199778:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883003520:12345-0@lo:13: Request processed in 121us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760581.199786:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789760581.199861:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27d0ef100 x1876699883003520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760597 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760581.199884:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883003520:0@lo:13: 00000100:00080000:0.0:1789760581.206191:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789760581.843543:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760582.736420:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883004032:0@lo:400: 00000100:00100000:2.0:1789760582.736510:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760582.736589:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789760582.736596:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1876699883003904:0@lo:400: 00000100:00100000:2.0:1789760582.736624:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760582.737117:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699883003648:0@lo:400: 00000100:00100000:3.0:1789760582.737159:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760582.737197:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1876699883004160:0@lo:400: 00000100:00100000:3.0:1789760582.737222:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760582.737244:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789760582.737260:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876699883003776:0@lo:400: 00000100:00100000:3.0:1789760582.737285:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760582.737303:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883004288:0@lo:400: 00000100:00100000:3.0:1789760582.737327:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760582.737359:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883003904 00000100:00100000:3.0:1789760582.737366:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883003904 00000100:00100000:3.0:1789760582.737413:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883004160 00000100:00100000:3.0:1789760582.737416:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883004160 00000100:00100000:3.0:1789760582.737429:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883003776 00000100:00100000:3.0:1789760582.737431:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883003776 00000100:00100000:3.0:1789760582.737447:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789760582.737455:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876699883003904:12345-0@lo:400: 00000100:00100000:3.0:1789760582.737506:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876699883003904:12345-0@lo:400: Request processed in 52us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760582.737525:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789760582.737541:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789760582.737547:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876699883004160:12345-0@lo:400: 00000100:00100000:3.0:1789760582.737575:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876699883004160:12345-0@lo:400: Request processed in 29us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760582.737581:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789760582.737590:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789760582.737595:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876699883003776:12345-0@lo:400: 00000100:00100000:3.0:1789760582.737618:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876699883003776:12345-0@lo:400: Request processed in 22us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760582.737624:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789760582.737647:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883004032 00000100:00100000:3.0:1789760582.737651:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883004032 00000100:00100000:3.0:1789760582.737674:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883004288 00000100:00100000:3.0:1789760582.737683:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883004288 00000100:00100000:3.0:1789760582.737704:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789760582.737709:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883004032:12345-0@lo:400: 00000100:00100000:3.0:1789760582.737980:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883004032:12345-0@lo:400: Request processed in 269us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760582.737987:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789760582.738000:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789760582.738006:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883004288:12345-0@lo:400: 00000100:00100000:3.0:1789760582.738032:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883004288:12345-0@lo:400: Request processed in 27us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760582.738037:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789760582.738078:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27d0eed80 x1876699883003776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760582.738093:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876699883003776:0@lo:400: 00010000:00080000:3.0:1789760582.738104:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27d0ec380 x1876699883004288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760582.738111:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789760582.738125:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883004288:0@lo:400: 00010000:00080000:3.0:1789760582.738134:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27d0ed180 x1876699883004160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760582.738142:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1876699883004160:0@lo:400: 00010000:00080000:3.0:1789760582.738169:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27d0ed880 x1876699883003904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760582.738177:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1876699883003904:0@lo:400: 00010000:00080000:3.0:1789760582.738197:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27d0ed500 x1876699883004032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760582.738205:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883004032:0@lo:400: 00000100:00100000:2.0:1789760582.738403:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883003648 00000100:00100000:2.0:1789760582.738409:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883003648 00000100:00100000:2.0:1789760582.738443:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789760582.738450:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247857050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+19:3308:x1876699883003648:12345-0@lo:400: 00000100:00100000:2.0:1789760582.738487:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247857050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+19:3308:x1876699883003648:12345-0@lo:400: Request processed in 39us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760582.738502:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789760582.738597:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699883003648:0@lo:400: 00000100:00080000:1.0:1789760582.738674:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789760582.738678:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789760582.863331:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760583.249232:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883004416:0@lo:13: 00000100:00100000:3.0:1789760583.249300:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760583.249413:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883004416 00000100:00100000:2.0:1789760583.249421:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883004416 00000100:00100000:2.0:1789760583.249469:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789760583.249478:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883004416:12345-0@lo:13: 00002000:00000024:2.0:1789760583.249522:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760583.249566:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883004416:12345-0@lo:13: Request processed in 89us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760583.249572:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789760583.250134:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27cc79180 x1876699883004416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760599 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760583.250154:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883004416:0@lo:13: 00000100:00100000:3.0:1789760583.347472:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760583.347641:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863056768 00000100:00100000:1.0:1789760583.347652:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863056768 00000100:00100000:1.0:1789760583.347705:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 113 00000100:00100000:1.0:1789760583.347713:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247857850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2347:x1876699863056768:12345-192.168.203.12@tcp:250: 00010000:00080000:1.0:1789760583.347743:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 940dde3d-5669-46e3-a0d8-2c83dea985ec@192.168.203.12@tcp t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:1.0:1789760583.347774:0:5839:0:(genops.c:1385:class_connect()) connect: client 940dde3d-5669-46e3-a0d8-2c83dea985ec, cookie 0x3e099f5ef04adb39 00000100:00080000:1.0:1789760583.347950:0:5839:0:(import.c:65:import_set_state_nolock()) ffff8df27ead2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789760583.348037:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247857850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+5:2347:x1876699863056768:12345-192.168.203.12@tcp:250: Request processed in 323us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760583.348046:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 113 00000100:00100000:1.0:1789760583.357270:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760583.357333:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863056640 00000100:00100000:3.0:1789760583.357344:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863056640 00000100:00100000:3.0:1789760583.357445:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:3.0:1789760583.357457:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247854c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+5:5574:x1876699863056640:12345-192.168.203.12@tcp:101: 00010000:00010000:3.0:1789760583.357475:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760583.357492:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df2778e9a00/0x3e099f5ef04adb40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2cef5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760583.357533:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df2778e9a00/0x3e099f5ef04adb40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cef5 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760583.357546:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df2778e9a00/0x3e099f5ef04adb40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cef5 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760583.357554:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2778e9a00, rc 0) 00000100:00100000:3.0:1789760583.357680:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247854c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+6:5574:x1876699863056640:12345-192.168.203.12@tcp:101: Request processed in 225us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760583.357701:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:3.0:1789760583.376405:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760583.376536:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863056896 00000100:00100000:2.0:1789760583.376546:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863056896 00000100:00100000:2.0:1789760583.376603:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:2.0:1789760583.376613:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247855050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+6:5574:x1876699863056896:12345-192.168.203.12@tcp:501: 00000100:00100000:2.0:1789760583.377015:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247855050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+6:5574:x1876699863056896:12345-192.168.203.12@tcp:501: Request processed in 402us (617us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789760583.377023:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:0.0:1789760583.379742:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760583.379848:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863057024 00000100:00100000:3.0:1789760583.379856:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863057024 00000100:00100000:3.0:1789760583.379905:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 116 00000100:00100000:3.0:1789760583.379915:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247857450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+6:5574:x1876699863057024:12345-192.168.203.12@tcp:101: 00010000:00010000:3.0:1789760583.379931:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760583.380092:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df2778e9200/0x3e099f5ef04adb47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2cefc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760583.380122:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df2778e9200/0x3e099f5ef04adb47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cefc expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760583.380135:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df2778e9200/0x3e099f5ef04adb47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cefc expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760583.380145:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2778e9200, rc 0) 00000100:00100000:3.0:1789760583.380205:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247857450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+7:5574:x1876699863057024:12345-192.168.203.12@tcp:101: Request processed in 290us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760583.380213:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 116 00000100:00100000:3.0:1789760583.382011:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760583.382107:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863057152 00000100:00100000:1.0:1789760583.382115:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863057152 00000100:00100000:1.0:1789760583.382165:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 117 00000100:00100000:1.0:1789760583.382175:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247855850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+7:5574:x1876699863057152:12345-192.168.203.12@tcp:501: 00000100:00100000:1.0:1789760583.382542:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247855850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+8:5574:x1876699863057152:12345-192.168.203.12@tcp:501: Request processed in 366us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760583.382549:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 117 00000100:00100000:2.0:1789760583.388458:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760583.388582:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863057280 00000100:00100000:3.0:1789760583.388591:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863057280 00000100:00100000:3.0:1789760583.388647:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:3.0:1789760583.388656:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247854450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+8:5574:x1876699863057280:12345-192.168.203.12@tcp:503: 00000100:00100000:3.0:1789760583.389067:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247854450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+8:5574:x1876699863057280:12345-192.168.203.12@tcp:503: Request processed in 411us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760583.389084:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:0.0:1789760583.400924:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760583.401023:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863057408 00000100:00100000:2.0:1789760583.401034:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863057408 00000100:00100000:2.0:1789760583.401087:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:2.0:1789760583.401097:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247856050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+8:5592:x1876699863057408:12345-192.168.203.12@tcp:502: 00000100:00100000:2.0:1789760583.401440:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247856050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+8:5592:x1876699863057408:12345-192.168.203.12@tcp:502: Request processed in 344us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760583.401449:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:0.0:1789760583.438222:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760583.438764:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863057536 00000100:00100000:1.0:1789760583.438776:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863057536 00000100:00100000:1.0:1789760583.439082:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:1.0:1789760583.439093:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247856850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+8:5592:x1876699863057536:12345-192.168.203.12@tcp:502: 00000100:00100000:1.0:1789760583.439836:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247856850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+8:5592:x1876699863057536:12345-192.168.203.12@tcp:502: Request processed in 740us (1619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760583.439845:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:0.0:1789760583.448842:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760583.449275:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863057664 00000100:00100000:3.0:1789760583.449285:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863057664 00000100:00100000:3.0:1789760583.449347:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:3.0:1789760583.449359:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247855c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+8:5574:x1876699863057664:12345-192.168.203.12@tcp:101: 00010000:00010000:3.0:1789760583.449376:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760583.449397:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df2778e8400/0x3e099f5ef04adb4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2cf26 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760583.449424:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df2778e8400/0x3e099f5ef04adb4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cf26 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760583.449435:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df2778e8400/0x3e099f5ef04adb4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cf26 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760583.449444:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2778e8400, rc 0) 00000100:00100000:3.0:1789760583.449533:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247855c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+9:5574:x1876699863057664:12345-192.168.203.12@tcp:101: Request processed in 176us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760583.449540:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:0.0:1789760583.454526:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760583.454711:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863057792 00000100:00100000:1.0:1789760583.454721:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863057792 00000100:00100000:1.0:1789760583.454964:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:1.0:1789760583.454991:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247854050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+9:5574:x1876699863057792:12345-192.168.203.12@tcp:256: 20000000:01000000:1.0:1789760583.455019:0:5839:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789760583.455046:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789760583.455050:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789760583.455053:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789760583.455055:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1789760583.457626:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247854050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+9:5574:x1876699863057792:12345-192.168.203.12@tcp:256: Request processed in 2628us (3106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760583.457640:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:0.0:1789760583.462406:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760583.466370:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863057920 00000100:00100000:2.0:1789760583.466385:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863057920 00000100:00100000:2.0:1789760583.466621:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:2.0:1789760583.466632:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+9:5574:x1876699863057920:12345-192.168.203.12@tcp:101: 00010000:00010000:2.0:1789760583.466650:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760583.466667:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241538c00/0x3e099f5ef04adb55 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2cf2d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760583.466694:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241538c00/0x3e099f5ef04adb55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cf2d expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760583.466705:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241538c00/0x3e099f5ef04adb55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cf2d expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760583.466714:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241538c00, rc 0) 00000100:00100000:2.0:1789760583.466791:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:5574:x1876699863057920:12345-192.168.203.12@tcp:101: Request processed in 161us (4396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760583.466798:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:0.0:1789760583.469240:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760583.469443:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863058048 00000100:00100000:1.0:1789760583.469456:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863058048 00000100:00100000:1.0:1789760583.469528:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:1.0:1789760583.469538:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258609050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:5574:x1876699863058048:12345-192.168.203.12@tcp:501: 00000100:00100000:1.0:1789760583.470283:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258609050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:5574:x1876699863058048:12345-192.168.203.12@tcp:501: Request processed in 743us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760583.470293:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:0.0:1789760583.473443:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760583.473586:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863058176 00000100:00100000:3.0:1789760583.473595:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863058176 00000100:00100000:3.0:1789760583.473653:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:3.0:1789760583.473663:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25860b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:5574:x1876699863058176:12345-192.168.203.12@tcp:503: 00000100:00100000:3.0:1789760583.474270:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25860b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:5574:x1876699863058176:12345-192.168.203.12@tcp:503: Request processed in 606us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760583.474280:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:0.0:1789760583.479306:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760583.479409:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863058304 00000100:00100000:2.0:1789760583.479421:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863058304 00000100:00100000:2.0:1789760583.479492:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:2.0:1789760583.479502:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:5596:x1876699863058304:12345-192.168.203.12@tcp:502: 00000100:00100000:2.0:1789760583.480269:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:5596:x1876699863058304:12345-192.168.203.12@tcp:502: Request processed in 764us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760583.480279:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:1.0:1789760583.482686:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760583.482922:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863058432 00000100:00100000:2.0:1789760583.482933:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863058432 00000100:00100000:2.0:1789760583.482999:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 127 00000100:00100000:2.0:1789760583.483008:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:5596:x1876699863058432:12345-192.168.203.12@tcp:502: 00000100:00100000:2.0:1789760583.483326:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:5596:x1876699863058432:12345-192.168.203.12@tcp:502: Request processed in 319us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760583.483335:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 127 00000100:00100000:1.0:1789760583.489128:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760583.489226:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863058560 00000100:00100000:3.0:1789760583.489248:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863058560 00000100:00100000:3.0:1789760583.489350:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:3.0:1789760583.489359:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2347:x1876699863058560:12345-192.168.203.12@tcp:38: 00010000:00080000:3.0:1789760583.489387:0:5846:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:3.0:1789760583.489440:0:5846:0:(genops.c:1385:class_connect()) connect: client 1da0113a-370d-4d79-883c-54efc174697f, cookie 0x3e099f5ef04adb5c 00000004:00100000:3.0:1789760583.489470:0:5846:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1789760583.489487:0:5846:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1789760583.527308:0:5846:0:(import.c:65:import_set_state_nolock()) ffff8df274a4f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789760583.527399:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2347:x1876699863058560:12345-192.168.203.12@tcp:38: Request processed in 38037us (38281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760583.527410:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00010000:00010000:0.0:1789760583.887037:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760584.532032:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760584.532322:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863058688 00000100:00100000:3.0:1789760584.532332:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863058688 00000100:00100000:3.0:1789760584.532408:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:3.0:1789760584.532418:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+6:0:x1876699863058688:12345-192.168.203.12@tcp:41: 00000004:00000024:3.0:1789760584.532459:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789760584.532543:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+6:0:x1876699863058688:12345-192.168.203.12@tcp:41: Request processed in 125us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760584.532551:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00080000:1.0:1789760584.532926:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760584.535894:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760584.536010:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863058816 00000100:00100000:2.0:1789760584.536020:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863058816 00000100:00100000:2.0:1789760584.536075:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1789760584.536084:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+6:5574:x1876699863058816:12345-192.168.203.12@tcp:41: 00000004:00000024:2.0:1789760584.536111:0:7279:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789760584.536176:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+6:5574:x1876699863058816:12345-192.168.203.12@tcp:41: Request processed in 93us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760584.536183:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:0.0:1789760584.538375:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760584.538579:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863058944 00000100:00100000:3.0:1789760584.538587:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863058944 00000100:00100000:3.0:1789760584.538637:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:3.0:1789760584.538647:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+6:5574:x1876699863058944:12345-192.168.203.12@tcp:40: 00000100:00100000:3.0:1789760584.538726:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+6:5574:x1876699863058944:12345-192.168.203.12@tcp:40: Request processed in 74us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760584.538748:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:0.0:1789760584.542291:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760584.542343:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760584.542440:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863059328 00000100:00100000:1.0:1789760584.542449:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863059328 00000100:00100000:1.0:1789760584.542515:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 128 00000100:00100000:1.0:1789760584.542525:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:2351:x1876699863059328:12345-192.168.203.12@tcp:400: 00000100:00100000:1.0:1789760584.542594:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:2351:x1876699863059328:12345-192.168.203.12@tcp:400: Request processed in 71us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760584.542601:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 128 00000100:00100000:3.0:1789760584.542670:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863059072 00000100:00100000:3.0:1789760584.542674:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863059072 00000100:00100000:3.0:1789760584.542702:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:3.0:1789760584.542707:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1876699863059072:12345-192.168.203.12@tcp:8: 00010000:00080000:3.0:1789760584.542742:0:6694:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:3.0:1789760584.542772:0:6694:0:(genops.c:1385:class_connect()) connect: client 1da0113a-370d-4d79-883c-54efc174697f, cookie 0x3e099f5ef04adb63 00002000:00100000:3.0:1789760584.542784:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1da0113a-370d-4d79-883c-54efc174697f/ffff8df274a4f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789760584.542831:0:6694:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789760584.543336:0:6694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789760584.543367:0:6694:0:(import.c:65:import_set_state_nolock()) ffff8df253567000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789760584.543403:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2347:x1876699863059072:12345-192.168.203.12@tcp:8: Request processed in 694us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760584.543410:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:0.0:1789760584.547574:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760584.547634:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760584.547739:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863059456 00000100:00100000:2.0:1789760584.547749:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863059456 00000100:00100000:2.0:1789760584.547837:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:2.0:1789760584.547847:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+6:5574:x1876699863059456:12345-192.168.203.12@tcp:33: 00000100:00100000:1.0:1789760584.548430:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863059200 00000100:00100000:1.0:1789760584.548435:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863059200 00000100:00100000:1.0:1789760584.548464:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:1.0:1789760584.548470:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1876699863059200:12345-192.168.203.12@tcp:8: 00010000:00080000:1.0:1789760584.548492:0:6695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:1.0:1789760584.548537:0:6695:0:(genops.c:1385:class_connect()) connect: client 1da0113a-370d-4d79-883c-54efc174697f, cookie 0x3e099f5ef04adb6a 00002000:00100000:1.0:1789760584.548557:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1da0113a-370d-4d79-883c-54efc174697f/ffff8df27ead3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789760584.548566:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789760584.549223:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789760584.549251:0:6695:0:(import.c:65:import_set_state_nolock()) ffff8df2513d6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789760584.549316:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2347:x1876699863059200:12345-192.168.203.12@tcp:8: Request processed in 844us (1751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760584.549324:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000004:00080000:3.0:1789760584.571936:0:5847:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 23679us 00000004:00200000:0.0:1789760584.608783:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789760584.608901:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+6:5574:x1876699863059456:12345-192.168.203.12@tcp:33: Request processed in 61051us (61262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760584.608915:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:0.0:1789760584.795064:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760584.795204:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863059584 00000100:00100000:2.0:1789760584.795214:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863059584 00000100:00100000:2.0:1789760584.795273:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:2.0:1789760584.795283:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+6:5613:x1876699863059584:12345-192.168.203.12@tcp:101: 00010000:00010000:2.0:1789760584.795303:0:7279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760584.795363:0:7279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539c00/0x3e099f5ef04adb71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2cf57 expref: -99 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760584.795426:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539600/0x3e099f5ef04adb78 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760584.795439:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539600/0x3e099f5ef04adb78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760584.795468:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539600/0x3e099f5ef04adb78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760584.795515:0:7279:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789760584.795519:0:7279:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789760584.795534:0:7279:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539600/0x3e099f5ef04adb78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760584.795561:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539c00/0x3e099f5ef04adb71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cf57 expref: 8 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760584.795579:0:7279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539600/0x3e099f5ef04adb78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cf57 expref: 7 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760584.795586:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df250325e00) 00010000:00010000:2.0:1789760584.795588:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789760584.795591:0:7279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241539600, rc 0) 00000100:00100000:2.0:1789760584.795649:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+7:5613:x1876699863059584:12345-192.168.203.12@tcp:101: Request processed in 368us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760584.795656:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00010000:00010000:1.0:1789760584.911842:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760585.935519:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760586.320934:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883004544:0@lo:13: 00000100:00100000:3.0:1789760586.321008:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760586.321560:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883004544 00000100:00100000:2.0:1789760586.321569:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883004544 00000100:00100000:2.0:1789760586.321630:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789760586.321638:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883004544:12345-0@lo:13: 00002000:00000024:2.0:1789760586.321672:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760586.321714:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883004544:12345-0@lo:13: Request processed in 77us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760586.321735:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1789760586.321852:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789760586.321884:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27cc78a80 x1876699883004544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760602 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760586.321904:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883004544:0@lo:13: 00000001:00100000:2.0:1789760586.399726:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1da0113a-370d-4d79-883c-54efc174697f 00010000:00010000:0.0:1789760586.959017:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760587.303604:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760587.303731:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863059712 00000100:00100000:3.0:1789760587.303740:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863059712 00000100:00100000:3.0:1789760587.303869:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:3.0:1789760587.303892:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+7:5666:x1876699863059712:12345-192.168.203.12@tcp:41: 00000004:00000024:3.0:1789760587.303933:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789760587.303995:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+7:5666:x1876699863059712:12345-192.168.203.12@tcp:41: Request processed in 104us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760587.304002:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00080000:1.0:1789760587.304161:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760587.312996:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760587.313108:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863059840 00000100:00100000:2.0:1789760587.313120:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863059840 00000100:00100000:2.0:1789760587.313203:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:2.0:1789760587.313214:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d715180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1da0113a-370d-4d79-883c-54efc174697f+5:5666:x1876699863059840:12345-192.168.203.12@tcp:13: 00002000:00000024:2.0:1789760587.313241:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760587.313306:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d715180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1da0113a-370d-4d79-883c-54efc174697f+5:5666:x1876699863059840:12345-192.168.203.12@tcp:13: Request processed in 95us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760587.313315:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00080000:1.0:1789760587.313400:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760587.324641:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760587.324780:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863059968 00000100:00100000:0.0:1789760587.324791:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863059968 00000100:00100000:0.0:1789760587.324915:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:0.0:1789760587.324937:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1da0113a-370d-4d79-883c-54efc174697f+6:5666:x1876699863059968:12345-192.168.203.12@tcp:13: 00002000:00000024:0.0:1789760587.324985:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760587.325055:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1da0113a-370d-4d79-883c-54efc174697f+6:5666:x1876699863059968:12345-192.168.203.12@tcp:13: Request processed in 131us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760587.325062:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00080000:1.0:1789760587.325143:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789760587.855152:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876699883004800:0@lo:400: 00000100:00100000:2.0:1789760587.855223:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760587.855280:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883005312:0@lo:400: 00000100:00100000:2.0:1789760587.855306:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760587.855338:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789760587.855345:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e2780560-8e82-4256-94b0-2e524f3bed06:3309:1876699883004672:0@lo:400: 00000100:00100000:2.0:1789760587.855372:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760587.855393:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1876699883005184:0@lo:400: 00000100:00100000:2.0:1789760587.855414:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760587.855441:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1876699883004928:0@lo:400: 00000100:00100000:2.0:1789760587.855464:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760587.855493:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789760587.855498:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883005056:0@lo:400: 00000100:00100000:2.0:1789760587.855520:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760587.855548:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883004800 00000100:00100000:2.0:1789760587.855566:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883004800 00000100:00100000:2.0:1789760587.855617:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883005184 00000100:00100000:2.0:1789760587.855620:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883005184 00000100:00100000:2.0:1789760587.855646:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883004928 00000100:00100000:2.0:1789760587.855650:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883004928 00000100:00100000:2.0:1789760587.855665:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789760587.855672:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876699883004800:12345-0@lo:400: 00000100:00100000:2.0:1789760587.855736:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876699883004800:12345-0@lo:400: Request processed in 63us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760587.855743:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789760587.855762:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789760587.855768:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876699883005184:12345-0@lo:400: 00000100:00100000:2.0:1789760587.855795:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876699883005184:12345-0@lo:400: Request processed in 28us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760587.855819:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789760587.855833:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789760587.855839:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876699883004928:12345-0@lo:400: 00000100:00100000:2.0:1789760587.855870:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876699883004928:12345-0@lo:400: Request processed in 31us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760587.855876:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789760587.855893:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883005312 00000100:00100000:2.0:1789760587.855897:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883005312 00000100:00100000:2.0:1789760587.855922:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883005056 00000100:00100000:2.0:1789760587.855925:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883005056 00000100:00100000:2.0:1789760587.855938:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789760587.855944:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883005312:12345-0@lo:400: 00000100:00100000:2.0:1789760587.855974:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883005312:12345-0@lo:400: Request processed in 30us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760587.855990:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789760587.856003:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789760587.856009:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883005056:12345-0@lo:400: 00000100:00100000:2.0:1789760587.856039:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883005056:12345-0@lo:400: Request processed in 31us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760587.856045:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789760587.856062:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883004672 00000100:00100000:2.0:1789760587.856066:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883004672 00000100:00100000:2.0:1789760587.856090:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789760587.856096:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3309:x1876699883004672:12345-0@lo:400: 00000100:00100000:2.0:1789760587.856125:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3309:x1876699883004672:12345-0@lo:400: Request processed in 30us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760587.856131:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:2.0:1789760587.856167:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789760587.856171:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789760587.856228:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27cc7aa00 x1876699883005056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760587.856242:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883005056:0@lo:400: 00000100:00100000:2.0:1789760587.856255:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1876699883004928:0@lo:400: 00000100:00100000:2.0:1789760587.856401:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e2780560-8e82-4256-94b0-2e524f3bed06:3309:1876699883004672:0@lo:400: 00000100:00100000:2.0:1789760587.856412:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1876699883005184:0@lo:400: 00000100:00100000:2.0:1789760587.856422:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876699883004800:0@lo:400: 00010000:00080000:2.0:1789760587.856432:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27cc7b480 x1876699883005312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760587.856453:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883005312:0@lo:400: 00010000:00010000:2.0:1789760587.984186:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760588.368296:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883005440:0@lo:13: 00000100:00100000:0.0:1789760588.368371:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760588.368450:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883005440 00000100:00100000:0.0:1789760588.368459:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883005440 00000100:00100000:0.0:1789760588.368517:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789760588.368526:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883005440:12345-0@lo:13: 00002000:00000024:0.0:1789760588.368558:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760588.368601:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883005440:12345-0@lo:13: Request processed in 76us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760588.368608:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1789760588.368651:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26d714a80 x1876699883005440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760604 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760588.368670:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883005440:0@lo:13: 00000001:00100000:0.0:1789760588.437201:0:7658:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1da0113a-370d-4d79-883c-54efc174697f 00000001:00100000:0.0:1789760588.963213:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1da0113a-370d-4d79-883c-54efc174697f 00010000:00010000:1.0:1789760589.008395:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760589.943365:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760589.943442:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760589.943533:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760589.943562:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760589.943587:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863060224 00000100:00100000:0.0:1789760589.943597:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863060224 00000100:00100000:0.0:1789760589.943658:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:0.0:1789760589.943668:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863060224:12345-192.168.203.12@tcp:400: 00000100:00100000:0.0:1789760589.943755:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863060224:12345-192.168.203.12@tcp:400: Request processed in 89us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760589.943763:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:0.0:1789760589.943787:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863060352 00000100:00100000:0.0:1789760589.943790:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863060352 00000100:00100000:0.0:1789760589.943837:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863060480 00000100:00100000:0.0:1789760589.943841:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863060480 00000100:00100000:0.0:1789760589.943875:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:0.0:1789760589.943882:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863060352:12345-192.168.203.12@tcp:400: 00000100:00100000:0.0:1789760589.943922:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863060352:12345-192.168.203.12@tcp:400: Request processed in 40us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760589.943928:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:0.0:1789760589.943941:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:0.0:1789760589.943948:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d714e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863060480:12345-192.168.203.12@tcp:400: 00000100:00100000:0.0:1789760589.943970:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d714e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863060480:12345-192.168.203.12@tcp:400: Request processed in 23us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760589.943975:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00080000:0.0:1789760589.943990:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789760589.943994:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789760589.943997:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760589.948121:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863060096 00000100:00100000:2.0:1789760589.948136:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863060096 00000100:00100000:0.0:1789760589.948708:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 130 00000100:00100000:0.0:1789760589.948719:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:2351:x1876699863060096:12345-192.168.203.12@tcp:400: 00000100:00100000:0.0:1789760589.949283:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:2351:x1876699863060096:12345-192.168.203.12@tcp:400: Request processed in 563us (5924us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760589.949291:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 130 00010000:00010000:0.0:1789760590.031009:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789760590.186976:0:8312:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789760591.065674:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760591.440712:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883005568:0@lo:13: 00000100:00100000:1.0:1789760591.440780:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760591.441123:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883005568 00000100:00100000:2.0:1789760591.441131:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883005568 00000100:00100000:2.0:1789760591.441208:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789760591.441217:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883005568:12345-0@lo:13: 00002000:00000024:2.0:1789760591.441255:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760591.441301:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883005568:12345-0@lo:13: Request processed in 86us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760591.441308:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1789760591.441398:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789760591.441430:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27cc7b480 x1876699883005568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760607 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760591.441458:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883005568:0@lo:13: 00010000:00010000:2.0:1789760592.088110:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760592.980965:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876699883005824:0@lo:400: 00000100:00100000:1.0:1789760592.981037:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760592.981089:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25855ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883006336:0@lo:400: 00000100:00100000:1.0:1789760592.981131:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760592.981165:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789760592.981172:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e2780560-8e82-4256-94b0-2e524f3bed06:3309:1876699883005696:0@lo:400: 00000100:00100000:1.0:1789760592.981209:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760592.981232:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1876699883006208:0@lo:400: 00000100:00100000:1.0:1789760592.981252:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760592.981277:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1876699883005952:0@lo:400: 00000100:00100000:1.0:1789760592.981298:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760592.981313:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789760592.981318:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883006080:0@lo:400: 00000100:00100000:1.0:1789760592.981338:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760592.981367:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883005824 00000100:00100000:1.0:1789760592.981374:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883005824 00000100:00100000:1.0:1789760592.981411:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883006208 00000100:00100000:1.0:1789760592.981414:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883006208 00000100:00100000:1.0:1789760592.981448:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883005952 00000100:00100000:1.0:1789760592.981451:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883005952 00000100:00100000:1.0:1789760592.981471:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789760592.981479:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25855aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876699883005824:12345-0@lo:400: 00000100:00100000:1.0:1789760592.981535:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25855aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876699883005824:12345-0@lo:400: Request processed in 56us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760592.981543:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789760592.981562:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789760592.981569:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876699883006208:12345-0@lo:400: 00000100:00100000:1.0:1789760592.981597:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876699883006208:12345-0@lo:400: Request processed in 28us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760592.981603:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789760592.981617:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789760592.981624:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876699883005952:12345-0@lo:400: 00000100:00100000:1.0:1789760592.981657:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876699883005952:12345-0@lo:400: Request processed in 34us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760592.981684:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789760592.981704:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883005696 00000100:00100000:1.0:1789760592.981708:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883005696 00000100:00100000:1.0:1789760592.981730:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789760592.981737:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:3309:x1876699883005696:12345-0@lo:400: 00000100:00100000:1.0:1789760592.981768:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:3309:x1876699883005696:12345-0@lo:400: Request processed in 32us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760592.981773:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:1.0:1789760592.981821:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760592.981852:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1876699883005952:0@lo:400: 00000100:00100000:1.0:1789760592.981876:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e2780560-8e82-4256-94b0-2e524f3bed06:3309:1876699883005696:0@lo:400: 00000100:00100000:1.0:1789760592.981884:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1876699883006208:0@lo:400: 00000100:00100000:1.0:1789760592.981892:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876699883005824:0@lo:400: 00000100:00100000:0.0:1789760592.982161:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883006336 00000100:00100000:0.0:1789760592.982166:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883006336 00000100:00100000:0.0:1789760592.982216:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883006080 00000100:00100000:0.0:1789760592.982219:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883006080 00000100:00100000:0.0:1789760592.982235:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789760592.982241:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883006336:12345-0@lo:400: 00000100:00100000:0.0:1789760592.982281:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883006336:12345-0@lo:400: Request processed in 40us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760592.982287:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789760592.982309:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789760592.982315:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883006080:12345-0@lo:400: 00000100:00100000:0.0:1789760592.982349:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883006080:12345-0@lo:400: Request processed in 34us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760592.982354:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1789760592.983143:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789760592.983175:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27c650700 x1876699883006080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760592.983187:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883006080:0@lo:400: 00010000:00080000:1.0:1789760592.983215:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df25855ad80 x1876699883006336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760592.983225:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25855ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883006336:0@lo:400: 00010000:00010000:3.0:1789760593.104462:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760593.491141:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789760593.491167:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883006464:0@lo:13: 00000100:00100000:1.0:1789760593.491232:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760593.492152:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883006464 00000100:00100000:2.0:1789760593.492160:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883006464 00000100:00100000:2.0:1789760593.492249:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789760593.492260:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883006464:12345-0@lo:13: 00002000:00000024:2.0:1789760593.492295:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760593.492370:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883006464:12345-0@lo:13: Request processed in 112us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760593.492377:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1789760593.492454:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df2747f9f80 x1876699883006464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760609 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760593.492474:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883006464:0@lo:13: 00000020:00000080:1.0:1789760594.028038:0:8459:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdf58ed360 20000000:00000080:1.0:1789760594.028055:0:8459:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df26d41d800 uarg=0000000000000000 20000000:01000000:1.0:1789760594.028092:0:8459:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1789760594.028094:0:8459:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1789760594.028097:0:8459:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789760594.028102:0:8459:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789760594.028107:0:8459:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1789760594.028122:0:8459:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789760594.028124:0:8459:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789760594.028292:0:8459:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789760594.028295:0:8459:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789760594.031499:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1789760594.032788:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1789760594.032881:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1789760594.032919:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1789760594.032935:0:8459:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789760594.032937:0:8459:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789760594.034580:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1789760594.035370:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1789760594.035418:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1789760594.035555:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1789760594.035573:0:8459:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789760594.035575:0:8459:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789760594.041239:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1789760594.042622:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1789760594.043048:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1789760594.043090:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1789760594.043105:0:8459:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789760594.043107:0:8459:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789760594.050375:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1789760594.050931:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1789760594.051012:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1789760594.051049:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:2.0:1789760594.051065:0:8459:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789760594.051085:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df241539c00/0x3e099f5ef04adb7f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.051104:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df241487600/0x3e099f5ef04ada7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ada75 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.051112:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df241674200/0x3e099f5ef04adaa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ada9f expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.051118:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df243a66400/0x3e099f5ef04adad0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04adac9 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.051124:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df241674600/0x3e099f5ef04adade lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04adad7 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.051130:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df243a67800/0x3e099f5ef04adaec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04adae5 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.051136:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df241674000/0x3e099f5ef04adb08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04adb01 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.051143:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df241675e00/0x3e099f5ef04adb32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04adb2b expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.051151:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df2778e9a00/0x3e099f5ef04adb40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cef5 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.051159:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df2778e9200/0x3e099f5ef04adb47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cefc expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.051176:0:8459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df241539c00/0x3e099f5ef04adb7f lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.051216:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df2778e9200/0x3e099f5ef04adb47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cefc expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.051232:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df2778e9200/0x3e099f5ef04adb47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cefc expref: 9 pid: 5837 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760594.051247:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc78380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1876699883006592:192.168.203.12@tcp:104: 00010000:00010000:2.0:1789760594.051346:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df2778e9a00/0x3e099f5ef04adb40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cef5 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.051355:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df2778e9a00/0x3e099f5ef04adb40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cef5 expref: 9 pid: 5837 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760594.051364:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc78700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1876699883006720:192.168.203.12@tcp:104: 00010000:00010000:2.0:1789760594.051394:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df241675e00/0x3e099f5ef04adb32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e099f5ef04adb2b expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.051402:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df241675e00/0x3e099f5ef04adb32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e099f5ef04adb2b expref: 18 pid: 5839 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760594.051411:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc7b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1876699883006848:0@lo:104: 00000100:00100000:2.0:1789760594.051471:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789760594.051503:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df241674000/0x3e099f5ef04adb08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e099f5ef04adb01 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.051521:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df241674000/0x3e099f5ef04adb08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e099f5ef04adb01 expref: 18 pid: 5837 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760594.051531:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc7aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1876699883006976:0@lo:104: 00000100:00100000:2.0:1789760594.051555:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760594.051593:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789760594.051604:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883006848 00000100:00100000:2.0:1789760594.051611:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883006848 00000100:00100000:2.0:1789760594.051640:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883006976 00000100:00100000:2.0:1789760594.051643:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883006976 00000100:00100000:2.0:1789760594.051658:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789760594.051665:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e2780560-8e82-4256-94b0-2e524f3bed06+4:8459:x1876699883006848:12345-0@lo:104: 00010000:00010000:2.0:1789760594.051677:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8df241674c00/0x3e099f5ef04adb2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04adb32 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.051719:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789760594.051725:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e2780560-8e82-4256-94b0-2e524f3bed06+4:8459:x1876699883006848:12345-0@lo:104: Request processed in 60us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760594.051731:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789760594.051747:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789760594.051753:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e2780560-8e82-4256-94b0-2e524f3bed06+3:8459:x1876699883006976:12345-0@lo:104: 00010000:00010000:2.0:1789760594.051760:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8df241675400/0x3e099f5ef04adb01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04adb08 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.051790:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789760594.051795:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e2780560-8e82-4256-94b0-2e524f3bed06+3:8459:x1876699883006976:12345-0@lo:104: Request processed in 43us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760594.051829:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1789760594.051865:0:7646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789760594.051870:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8df241674c00/0x3e099f5ef04adb2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04adb32 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.051877:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674c00 already unused, calling callback (ffffffffc1be8c20) 10000000:00010000:2.0:1789760594.051881:0:7646:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8df241674c00/0x3e099f5ef04adb2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e099f5ef04adb32 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.051889:0:7646:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8df241674c00/0x3e099f5ef04adb2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e099f5ef04adb32 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789760594.051896:0:7646:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8df241674c00/0x3e099f5ef04adb2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e099f5ef04adb32 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760594.051902:0:7646:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789760594.051936:0:7646:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8df241674c00/0x3e099f5ef04adb2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04adb32 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.051942:0:7646:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789760594.051958:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8df241674c00/0x3e099f5ef04adb2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04adb32 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.051981:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8df241674c00/0x3e099f5ef04adb2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04adb32 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.051994:0:7646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789760594.051998:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8df241675400/0x3e099f5ef04adb01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04adb08 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.052013:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241675400 already unused, calling callback (ffffffffc1be8c20) 10000000:00010000:2.0:1789760594.052015:0:7646:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8df241675400/0x3e099f5ef04adb01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e099f5ef04adb08 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.052022:0:7646:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8df241675400/0x3e099f5ef04adb01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e099f5ef04adb08 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789760594.052027:0:7646:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8df241675400/0x3e099f5ef04adb01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e099f5ef04adb08 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760594.052033:0:7646:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789760594.052047:0:7646:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8df241675400/0x3e099f5ef04adb01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04adb08 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.052053:0:7646:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789760594.052065:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8df241675400/0x3e099f5ef04adb01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04adb08 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.052071:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8df241675400/0x3e099f5ef04adb01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04adb08 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.052083:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760594.052084:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760594.052087:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760594.052094:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789760594.052105:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883007104:0@lo:103: 00000100:00100000:2.0:1789760594.052133:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760594.052163:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699883007232:0@lo:103: 00000100:00100000:2.0:1789760594.052196:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760594.052225:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883007104 00000100:00100000:2.0:1789760594.052229:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883007104 00010000:00010000:2.0:1789760594.052247:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df241675e00/0x3e099f5ef04adb32 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04adb2b expref: 19 pid: 5839 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760594.052264:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883007232 00000100:00100000:2.0:1789760594.052266:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883007232 00010000:00010000:2.0:1789760594.052276:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df241674000/0x3e099f5ef04adb08 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04adb01 expref: 20 pid: 5837 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760594.052293:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789760594.052299:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2780560-8e82-4256-94b0-2e524f3bed06+20:3310:x1876699883007104:12345-0@lo:103: 00010000:00010000:2.0:1789760594.052309:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760594.052314:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df241675e00/0x3e099f5ef04adb32 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04adb2b expref: 20 pid: 5839 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.052322:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df241675e00/0x3e099f5ef04adb32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e099f5ef04adb2b expref: 20 pid: 5839 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.052336:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760594.052363:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2780560-8e82-4256-94b0-2e524f3bed06+20:3310:x1876699883007104:12345-0@lo:103: Request processed in 64us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760594.052369:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789760594.052381:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789760594.052387:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3308:x1876699883007232:12345-0@lo:103: 00010000:00010000:2.0:1789760594.052394:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760594.052398:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df241674000/0x3e099f5ef04adb08 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04adb01 expref: 19 pid: 5837 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.052416:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df241674000/0x3e099f5ef04adb08 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e099f5ef04adb01 expref: 19 pid: 5837 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.052426:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760594.052464:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3308:x1876699883007232:12345-0@lo:103: Request processed in 78us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760594.052470:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789760594.052508:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699883007232:0@lo:103: 00000100:00100000:2.0:1789760594.052530:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883007104:0@lo:103: 00010000:00010000:2.0:1789760594.052557:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df243a67800/0x3e099f5ef04adaec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e099f5ef04adae5 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.052566:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df243a67800/0x3e099f5ef04adaec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e099f5ef04adae5 expref: 18 pid: 5839 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760594.052574:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc78e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1876699883007360:0@lo:104: 00000100:00100000:2.0:1789760594.052596:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760594.052615:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883007360 00000100:00100000:2.0:1789760594.052619:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883007360 00000100:00100000:2.0:1789760594.052635:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789760594.052641:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e2780560-8e82-4256-94b0-2e524f3bed06+3:8459:x1876699883007360:12345-0@lo:104: 00010000:00010000:2.0:1789760594.052650:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8df241538600/0x3e099f5ef04adae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04adaec expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.052681:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789760594.052686:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e2780560-8e82-4256-94b0-2e524f3bed06+3:8459:x1876699883007360:12345-0@lo:104: Request processed in 45us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760594.052699:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1789760594.052728:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df241674600/0x3e099f5ef04adade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e099f5ef04adad7 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.052736:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df241674600/0x3e099f5ef04adade lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e099f5ef04adad7 expref: 18 pid: 5837 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760594.052744:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc7b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1876699883007488:0@lo:104: 00000100:00100000:2.0:1789760594.052765:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760594.052781:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883007488 00000100:00100000:2.0:1789760594.052784:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883007488 00000100:00100000:2.0:1789760594.052798:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789760594.052821:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e2780560-8e82-4256-94b0-2e524f3bed06+3:8459:x1876699883007488:12345-0@lo:104: 00010000:00010000:2.0:1789760594.052828:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8df241486200/0x3e099f5ef04adad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04adade expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.052854:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789760594.052858:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e2780560-8e82-4256-94b0-2e524f3bed06+3:8459:x1876699883007488:12345-0@lo:104: Request processed in 56us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760594.052863:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1789760594.052875:0:7646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789760594.052879:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8df241538600/0x3e099f5ef04adae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04adaec expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.052886:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241538600 already unused, calling callback (ffffffffc1be8c20) 10000000:00010000:2.0:1789760594.052889:0:7646:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8df241538600/0x3e099f5ef04adae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e099f5ef04adaec expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.052896:0:7646:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8df241538600/0x3e099f5ef04adae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e099f5ef04adaec expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789760594.052909:0:7646:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8df241538600/0x3e099f5ef04adae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e099f5ef04adaec expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760594.052914:0:7646:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789760594.052927:0:7646:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8df241538600/0x3e099f5ef04adae5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04adaec expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.052933:0:7646:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789760594.052941:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8df241538600/0x3e099f5ef04adae5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04adaec expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.052948:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8df241538600/0x3e099f5ef04adae5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04adaec expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.052958:0:7646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789760594.052961:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8df241486200/0x3e099f5ef04adad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04adade expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.052966:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241486200 already unused, calling callback (ffffffffc1be8c20) 10000000:00010000:2.0:1789760594.052969:0:7646:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8df241486200/0x3e099f5ef04adad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e099f5ef04adade expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.052975:0:7646:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8df241486200/0x3e099f5ef04adad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e099f5ef04adade expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789760594.052981:0:7646:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8df241486200/0x3e099f5ef04adad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e099f5ef04adade expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760594.052986:0:7646:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789760594.053022:0:7646:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8df241486200/0x3e099f5ef04adad7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04adade expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.053028:0:7646:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789760594.053038:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8df241486200/0x3e099f5ef04adad7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04adade expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.053045:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8df241486200/0x3e099f5ef04adad7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04adade expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.053055:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760594.053056:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760594.053058:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760594.053065:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789760594.053073:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699883007616:0@lo:103: 00010000:00010000:3.0:1789760594.053073:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760594.053099:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760594.053132:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d3f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883007744:0@lo:103: 00000100:00100000:2.0:1789760594.053155:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760594.053189:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883007616 00000100:00100000:2.0:1789760594.053192:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883007616 00010000:00010000:2.0:1789760594.053205:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df243a67800/0x3e099f5ef04adaec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04adae5 expref: 19 pid: 5839 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760594.053220:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883007744 00000100:00100000:2.0:1789760594.053223:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883007744 00010000:00010000:2.0:1789760594.053233:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df241674600/0x3e099f5ef04adade lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04adad7 expref: 20 pid: 5837 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760594.053244:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789760594.053249:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2780560-8e82-4256-94b0-2e524f3bed06+20:3308:x1876699883007616:12345-0@lo:103: 00010000:00010000:2.0:1789760594.053265:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760594.053270:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df243a67800/0x3e099f5ef04adaec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04adae5 expref: 20 pid: 5839 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.053279:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df243a67800/0x3e099f5ef04adaec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e099f5ef04adae5 expref: 20 pid: 5839 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.053289:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760594.053315:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2780560-8e82-4256-94b0-2e524f3bed06+20:3308:x1876699883007616:12345-0@lo:103: Request processed in 66us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760594.053321:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789760594.053333:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789760594.053339:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883007744:12345-0@lo:103: 00010000:00010000:2.0:1789760594.053347:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760594.053351:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df241674600/0x3e099f5ef04adade lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04adad7 expref: 19 pid: 5837 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.053358:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df241674600/0x3e099f5ef04adade lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e099f5ef04adad7 expref: 19 pid: 5837 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.053367:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760594.053391:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883007744:12345-0@lo:103: Request processed in 52us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760594.053396:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789760594.053424:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d3f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883007744:0@lo:103: 00010000:00010000:1.0:1789760594.054782:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760594.055929:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df243a66400/0x3e099f5ef04adad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e099f5ef04adac9 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760594.055945:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df243a66400/0x3e099f5ef04adad0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e099f5ef04adac9 expref: 18 pid: 5837 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760594.055958:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747fb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1876699883007872:0@lo:104: 00000100:00100000:3.0:1789760594.056013:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789760594.056055:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df241674200/0x3e099f5ef04adaa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e099f5ef04ada9f expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760594.056065:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df241674200/0x3e099f5ef04adaa6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e099f5ef04ada9f expref: 18 pid: 5839 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760594.056073:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747fb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1876699883008000:0@lo:104: 00000100:00100000:3.0:1789760594.056097:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789760594.056122:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df241487600/0x3e099f5ef04ada7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e099f5ef04ada75 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760594.056145:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df241487600/0x3e099f5ef04ada7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e099f5ef04ada75 expref: 18 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760594.056154:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747faa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1876699883008128:0@lo:104: 00000100:00100000:3.0:1789760594.056178:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760594.056188:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df24574d6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789760594.056206:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241675e00/0x3e099f5ef04adb32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e099f5ef04adb2b expref: 18 pid: 5839 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760594.056220:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc7b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1876699883006848:0@lo:104: 00010000:00010000:3.0:1789760594.056230:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241674000/0x3e099f5ef04adb08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e099f5ef04adb01 expref: 17 pid: 5837 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760594.056239:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc7aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1876699883006976:0@lo:104: 00010000:00010000:3.0:1789760594.056249:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df243a67800/0x3e099f5ef04adaec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e099f5ef04adae5 expref: 16 pid: 5839 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760594.056272:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc78e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1876699883007360:0@lo:104: 00010000:00010000:3.0:1789760594.056283:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241674600/0x3e099f5ef04adade lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e099f5ef04adad7 expref: 15 pid: 5837 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760594.056291:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc7b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1876699883007488:0@lo:104: 00000100:00100000:0.0:1789760594.058211:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883007872 00000100:00100000:0.0:1789760594.058223:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883007872 00000100:00100000:0.0:1789760594.058415:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883008000 00000100:00100000:0.0:1789760594.058419:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883008000 00000100:00100000:0.0:1789760594.058444:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883008128 00000100:00100000:0.0:1789760594.058447:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883008128 00000100:00100000:0.0:1789760594.058474:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789760594.058483:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e2780560-8e82-4256-94b0-2e524f3bed06+5:8459:x1876699883007872:12345-0@lo:104: 00010000:00010000:0.0:1789760594.058507:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8df241539a00/0x3e099f5ef04adac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04adad0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760594.058585:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789760594.058590:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e2780560-8e82-4256-94b0-2e524f3bed06+5:8459:x1876699883007872:12345-0@lo:104: Request processed in 109us (2578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760594.058835:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789760594.058860:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789760594.058868:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e2780560-8e82-4256-94b0-2e524f3bed06+4:8459:x1876699883008000:12345-0@lo:104: 00010000:00010000:0.0:1789760594.058877:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8df243a66800/0x3e099f5ef04ada9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04adaa6 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760594.058913:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789760594.058919:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e2780560-8e82-4256-94b0-2e524f3bed06+4:8459:x1876699883008000:12345-0@lo:104: Request processed in 53us (2821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760594.058937:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789760594.058954:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789760594.058964:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e2780560-8e82-4256-94b0-2e524f3bed06+3:8459:x1876699883008128:12345-0@lo:104: 00000100:00100000:3.0:1789760594.058964:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747fb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1876699883007872:0@lo:104: 00010000:00010000:0.0:1789760594.058984:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8df241675a00/0x3e099f5ef04ada75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ada7c expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760594.058995:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747fb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1876699883008000:0@lo:104: 00010000:00010000:0.0:1789760594.059041:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789760594.059050:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e2780560-8e82-4256-94b0-2e524f3bed06+3:8459:x1876699883008128:12345-0@lo:104: Request processed in 89us (2870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760594.059063:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747faa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1876699883008128:0@lo:104: 00000100:00100000:0.0:1789760594.059064:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1789760594.059099:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789760594.059107:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8df241539a00/0x3e099f5ef04adac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04adad0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760594.059115:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241539a00 already unused, calling callback (ffffffffc1be8c20) 10000000:00010000:0.0:1789760594.059119:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8df241539a00/0x3e099f5ef04adac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e099f5ef04adad0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760594.059127:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8df241539a00/0x3e099f5ef04adac9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e099f5ef04adad0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760594.059134:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8df241539a00/0x3e099f5ef04adac9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e099f5ef04adad0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760594.059139:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760594.059179:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8df241539a00/0x3e099f5ef04adac9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04adad0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760594.059185:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760594.059215:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8df241539a00/0x3e099f5ef04adac9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04adad0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760594.059222:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8df241539a00/0x3e099f5ef04adac9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04adad0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760594.059236:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789760594.059239:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8df243a66800/0x3e099f5ef04ada9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04adaa6 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760594.059245:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66800 already unused, calling callback (ffffffffc1be8c20) 10000000:00010000:0.0:1789760594.059248:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8df243a66800/0x3e099f5ef04ada9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e099f5ef04adaa6 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760594.059254:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8df243a66800/0x3e099f5ef04ada9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e099f5ef04adaa6 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760594.060129:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8df243a66800/0x3e099f5ef04ada9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e099f5ef04adaa6 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760594.060134:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760594.060181:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8df243a66800/0x3e099f5ef04ada9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04adaa6 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760594.060188:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760594.060199:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8df243a66800/0x3e099f5ef04ada9f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04adaa6 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760594.060205:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8df243a66800/0x3e099f5ef04ada9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04adaa6 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760594.060216:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789760594.060227:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8df241675a00/0x3e099f5ef04ada75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ada7c expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760594.060233:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241675a00 already unused, calling callback (ffffffffc1be8c20) 10000000:00010000:0.0:1789760594.060236:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8df241675a00/0x3e099f5ef04ada75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e099f5ef04ada7c expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760594.060242:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8df241675a00/0x3e099f5ef04ada75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e099f5ef04ada7c expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760594.060248:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8df241675a00/0x3e099f5ef04ada75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e099f5ef04ada7c expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760594.060253:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760594.060391:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8df241675a00/0x3e099f5ef04ada75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ada7c expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760594.060398:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760594.060404:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8df241675a00/0x3e099f5ef04ada75 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ada7c expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760594.060409:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8df241675a00/0x3e099f5ef04ada75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ada7c expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760594.060425:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760594.060436:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760594.060439:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760594.060503:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760594.060712:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277cd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e2780560-8e82-4256-94b0-2e524f3bed06:3309:1876699883008512:0@lo:103: 00000100:00100000:1.0:1789760594.060779:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760594.060852:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789760594.060858:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277cdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e2780560-8e82-4256-94b0-2e524f3bed06:3309:1876699883008384:0@lo:103: 00000100:00100000:1.0:1789760594.060877:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760594.060908:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699883008256:0@lo:103: 00000100:00100000:1.0:1789760594.060928:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760594.060953:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883008512 00000100:00100000:1.0:1789760594.060958:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883008512 00010000:00010000:1.0:1789760594.060980:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df241487600/0x3e099f5ef04ada7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ada75 expref: 15 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760594.061002:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883008384 00000100:00100000:1.0:1789760594.061005:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883008384 00010000:00010000:1.0:1789760594.061016:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df241674200/0x3e099f5ef04adaa6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ada9f expref: 16 pid: 5839 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760594.061026:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883008256 00000100:00100000:1.0:1789760594.061028:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883008256 00010000:00010000:1.0:1789760594.061038:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df243a66400/0x3e099f5ef04adad0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04adac9 expref: 17 pid: 5837 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760594.061051:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789760594.061057:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2780560-8e82-4256-94b0-2e524f3bed06+17:3309:x1876699883008512:12345-0@lo:103: 00010000:00010000:1.0:1789760594.061067:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760594.061072:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df241487600/0x3e099f5ef04ada7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ada75 expref: 17 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760594.061081:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df241487600/0x3e099f5ef04ada7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e099f5ef04ada75 expref: 17 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760594.061095:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241487600/0x3e099f5ef04ada7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e099f5ef04ada75 expref: 17 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760594.061107:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760594.061138:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2780560-8e82-4256-94b0-2e524f3bed06+16:3309:x1876699883008512:12345-0@lo:103: Request processed in 80us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760594.061150:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789760594.061166:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789760594.061172:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2780560-8e82-4256-94b0-2e524f3bed06+15:3309:x1876699883008384:12345-0@lo:103: 00010000:00010000:1.0:1789760594.061179:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760594.061183:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df241674200/0x3e099f5ef04adaa6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ada9f expref: 15 pid: 5839 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760594.061192:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df241674200/0x3e099f5ef04adaa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e099f5ef04ada9f expref: 15 pid: 5839 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760594.061201:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241674200/0x3e099f5ef04adaa6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e099f5ef04ada9f expref: 15 pid: 5839 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760594.061212:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760594.061235:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2780560-8e82-4256-94b0-2e524f3bed06+14:3309:x1876699883008384:12345-0@lo:103: Request processed in 64us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760594.061240:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789760594.061251:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789760594.061275:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df260390450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2780560-8e82-4256-94b0-2e524f3bed06+13:3311:x1876699883008256:12345-0@lo:103: 00010000:00010000:1.0:1789760594.061282:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760594.061286:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df243a66400/0x3e099f5ef04adad0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04adac9 expref: 13 pid: 5837 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760594.061294:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df243a66400/0x3e099f5ef04adad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e099f5ef04adac9 expref: 13 pid: 5837 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760594.061303:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df243a66400/0x3e099f5ef04adad0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e099f5ef04adac9 expref: 13 pid: 5837 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760594.061321:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760594.061346:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df260390450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2780560-8e82-4256-94b0-2e524f3bed06+12:3311:x1876699883008256:12345-0@lo:103: Request processed in 90us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760594.061352:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1789760594.061396:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760594.061417:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699883008256:0@lo:103: 00000100:00100000:1.0:1789760594.061458:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277cdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e2780560-8e82-4256-94b0-2e524f3bed06:3309:1876699883008384:0@lo:103: 00000100:00100000:1.0:1789760594.061468:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277cd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e2780560-8e82-4256-94b0-2e524f3bed06:3309:1876699883008512:0@lo:103: 00000100:00100000:2.0:1789760594.061942:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699883007616:0@lo:103: 00000100:00100000:0.0:1789760594.062497:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760594.062527:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760594.062796:0:7645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863060608 00000100:00100000:1.0:1789760594.062829:0:7645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863060608 00010000:00010000:1.0:1789760594.062858:0:7645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df2778e9200/0x3e099f5ef04adb47 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cefc expref: 10 pid: 5837 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760594.062885:0:7645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863060736 00000100:00100000:1.0:1789760594.062888:0:7645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863060736 00010000:00010000:1.0:1789760594.062899:0:7645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df2778e9a00/0x3e099f5ef04adb40 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cef5 expref: 11 pid: 5837 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760594.062918:0:7645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:1.0:1789760594.062926:0:7645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:940dde3d-5669-46e3-a0d8-2c83dea985ec+11:2349:x1876699863060608:12345-192.168.203.12@tcp:103: 00010000:00010000:1.0:1789760594.062936:0:7645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760594.062940:0:7645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df2778e9200/0x3e099f5ef04adb47 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cefc expref: 11 pid: 5837 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760594.062949:0:7645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df2778e9200/0x3e099f5ef04adb47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cefc expref: 11 pid: 5837 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760594.062979:0:7645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760594.063021:0:7645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:940dde3d-5669-46e3-a0d8-2c83dea985ec+11:2349:x1876699863060608:12345-192.168.203.12@tcp:103: Request processed in 96us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760594.063028:0:7645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:1.0:1789760594.063047:0:7645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:1.0:1789760594.063053:0:7645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cd9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:2348:x1876699863060736:12345-192.168.203.12@tcp:103: 00010000:00010000:1.0:1789760594.063060:0:7645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760594.063064:0:7645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df2778e9a00/0x3e099f5ef04adb40 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cef5 expref: 10 pid: 5837 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760594.063073:0:7645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df2778e9a00/0x3e099f5ef04adb40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cef5 expref: 10 pid: 5837 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760594.063085:0:7645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df241539c00/0x3e099f5ef04adb7f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760594.063093:0:7645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241539c00/0x3e099f5ef04adb7f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760594.063107:0:7645:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df241539c00/0x3e099f5ef04adb7f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760594.063115:0:7645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df241539c00/0x3e099f5ef04adb7f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760594.063122:0:7645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df241539c00/0x3e099f5ef04adb7f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760594.063128:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df241539c00/0x3e099f5ef04adb7f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760594.063141:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241539c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760594.063145:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df241539c00/0x3e099f5ef04adb7f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760594.063153:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df241539c00/0x3e099f5ef04adb7f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760594.063162:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df241539c00/0x3e099f5ef04adb7f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760594.063172:0:7645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760594.063193:0:7645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cd9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:2348:x1876699863060736:12345-192.168.203.12@tcp:103: Request processed in 140us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760594.063200:0:7645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00010000:00010000:2.0:1789760594.063997:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df2778e9200/0x3e099f5ef04adb47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cefc expref: 9 pid: 5837 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760594.064026:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc78380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1876699883006592:192.168.203.12@tcp:104: 00010000:00010000:2.0:1789760594.064040:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df2778e9a00/0x3e099f5ef04adb40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cef5 expref: 8 pid: 5837 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760594.064049:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc78700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1876699883006720:192.168.203.12@tcp:104: 00010000:00010000:2.0:1789760594.064088:0:8459:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df241539c00/0x3e099f5ef04adb7f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.064097:0:8459:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df241539c00/0x3e099f5ef04adb7f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.064104:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df241539c00/0x3e099f5ef04adb7f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760594.064109:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241539c00/0x3e099f5ef04adb7f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760594.127000:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760595.060974:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760595.061028:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760595.061063:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760595.061097:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760595.061125:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863061120 00000100:00100000:0.0:1789760595.061134:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863061120 00000100:00100000:0.0:1789760595.061185:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863061248 00000100:00100000:0.0:1789760595.061189:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863061248 00000100:00100000:0.0:1789760595.061207:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:0.0:1789760595.061216:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863061120:12345-192.168.203.12@tcp:400: 00000100:00100000:0.0:1789760595.061287:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863061120:12345-192.168.203.12@tcp:400: Request processed in 72us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760595.061296:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:0.0:1789760595.061312:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:0.0:1789760595.061319:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863061248:12345-192.168.203.12@tcp:400: 00000100:00100000:0.0:1789760595.061342:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863061248:12345-192.168.203.12@tcp:400: Request processed in 24us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760595.061349:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:3.0:1789760595.061520:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863060992 00000100:00100000:3.0:1789760595.061525:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863060992 00000100:00100000:3.0:1789760595.061566:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:3.0:1789760595.061574:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863060992:12345-192.168.203.12@tcp:400: 00000100:00100000:3.0:1789760595.061611:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863060992:12345-192.168.203.12@tcp:400: Request processed in 38us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760595.061618:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00080000:1.0:1789760595.062960:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789760595.062968:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789760595.062971:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760595.063693:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863060864 00000100:00100000:2.0:1789760595.063702:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863060864 00000100:00100000:2.0:1789760595.063755:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 132 00000100:00100000:2.0:1789760595.063765:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+8:2349:x1876699863060864:12345-192.168.203.12@tcp:400: 00000100:00100000:2.0:1789760595.063867:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+8:2349:x1876699863060864:12345-192.168.203.12@tcp:400: Request processed in 103us (2903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760595.063875:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 132 00010000:00010000:3.0:1789760595.151042:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789760595.215775:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789760595.215783:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df26cd8e800 from 39 10000000:01000000:0.0:1789760595.215788:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789760595.216049:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df243a66800/0x3e099f5ef04adb86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760595.216062:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8df243a66800/0x3e099f5ef04adb86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760595.216073:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8df243a66800/0x3e099f5ef04adb86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760595.216116:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277cdbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883008640:0@lo:101: 00000100:00100000:0.0:1789760595.216192:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760595.216305:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df27ce93180 going to sleep for 11 seconds 00000100:00100000:2.0:1789760595.218971:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883008640 00000100:00100000:2.0:1789760595.218984:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883008640 00000100:00100000:2.0:1789760595.219109:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789760595.219132:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+12:5842:x1876699883008640:12345-0@lo:101: 00010000:00010000:2.0:1789760595.219148:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760595.219167:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241539c00/0x3e099f5ef04adb8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04adb86 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760595.219193:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241539c00/0x3e099f5ef04adb8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04adb86 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760595.219204:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241539c00/0x3e099f5ef04adb8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04adb86 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760595.219212:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241539c00, rc 0) 00000100:00100000:2.0:1789760595.219288:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+13:5842:x1876699883008640:12345-0@lo:101: Request processed in 158us (3095us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760595.219294:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789760595.219382:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277cdbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883008640:0@lo:101: 00010000:00010000:3.0:1789760595.219398:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8df243a66800/0x3e099f5ef04adb86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adb8d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760595.219407:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8df243a66800/0x3e099f5ef04adb86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04adb8d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760595.219489:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883008768:0@lo:501: 00000100:00100000:3.0:1789760595.219525:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760595.232463:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df251e5d180 going to sleep for 11 seconds 00000100:00100000:0.0:1789760595.240768:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883008768 00000100:00100000:0.0:1789760595.240784:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883008768 00000100:00100000:0.0:1789760595.240869:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789760595.240880:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+13:5842:x1876699883008768:12345-0@lo:501: 00000100:00100000:0.0:1789760595.241183:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+13:5842:x1876699883008768:12345-0@lo:501: Request processed in 304us (21656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760595.241190:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789760595.241319:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883008768:0@lo:501: 00000100:00100000:3.0:1789760595.241365:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883008896:0@lo:503: 00000100:00100000:3.0:1789760595.241410:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760595.241457:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df251e5d180 going to sleep for 11 seconds 00000100:00100000:0.0:1789760595.241561:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883008896 00000100:00100000:0.0:1789760595.241566:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883008896 00000100:00100000:0.0:1789760595.241587:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789760595.241593:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+13:5842:x1876699883008896:12345-0@lo:503: 00000100:00100000:0.0:1789760595.241878:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+13:5842:x1876699883008896:12345-0@lo:503: Request processed in 283us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760595.241885:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789760595.244506:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883008896:0@lo:503: 00000100:00100000:3.0:1789760595.245221:0:8476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8476:1876699883009024:0@lo:502: 00000100:00100000:3.0:1789760595.245295:0:8476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760595.245354:0:8476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df251e5d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789760595.245410:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883009024 00000100:00100000:0.0:1789760595.245431:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883009024 00000100:00100000:0.0:1789760595.245476:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789760595.245486:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+13:8476:x1876699883009024:12345-0@lo:502: 00000100:00100000:0.0:1789760595.245991:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+13:8476:x1876699883009024:12345-0@lo:502: Request processed in 504us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760595.245999:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789760595.246181:0:8476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8476:1876699883009024:0@lo:502: 00000100:00100000:3.0:1789760595.246227:0:8476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8476:1876699883009152:0@lo:502: 00000100:00100000:3.0:1789760595.246261:0:8476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760595.246332:0:8476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df251e5d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760595.248075:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883009152 00000100:00100000:1.0:1789760595.248086:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883009152 00000100:00100000:2.0:1789760595.250624:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789760595.250710:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+13:8476:x1876699883009152:12345-0@lo:502: 00000100:00100000:3.0:1789760595.251177:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+13:8476:x1876699883009152:12345-0@lo:502: Request processed in 539us (4913us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760595.251186:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789760595.251294:0:8476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8476:1876699883009152:0@lo:502: 00000040:00080000:2.0:1789760595.251328:0:8476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789760595.252539:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789760595.252569:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789760595.252604:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df243a66800/0x3e099f5ef04adb86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adb8d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760595.252616:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8df243a66800/0x3e099f5ef04adb86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adb8d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760595.252626:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789760595.252629:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1789760595.252640:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789760595.252786:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df243a66400/0x3e099f5ef04adb94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760595.252795:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8df243a66400/0x3e099f5ef04adb94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760595.252839:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8df243a66400/0x3e099f5ef04adb94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760595.252868:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277cda300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883009280:0@lo:101: 00000100:00100000:0.0:1789760595.252923:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760595.252966:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df27ce93540 going to sleep for 11 seconds 00000100:00100000:2.0:1789760595.253403:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883009280 00000100:00100000:2.0:1789760595.253410:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883009280 00000100:00100000:2.0:1789760595.253482:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789760595.253491:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+13:5842:x1876699883009280:12345-0@lo:101: 00010000:00010000:2.0:1789760595.253505:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760595.253517:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241538600/0x3e099f5ef04adb9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04adb94 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760595.253539:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241538600/0x3e099f5ef04adb9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04adb94 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760595.253559:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241538600/0x3e099f5ef04adb9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04adb94 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760595.253568:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241538600, rc 0) 00000100:00100000:2.0:1789760595.253626:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+14:5842:x1876699883009280:12345-0@lo:101: Request processed in 136us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760595.253632:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789760595.254128:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277cda300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883009280:0@lo:101: 00010000:00010000:0.0:1789760595.254144:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8df243a66400/0x3e099f5ef04adb94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adb9b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760595.254153:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8df243a66400/0x3e099f5ef04adb94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04adb9b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760595.254208:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277cda300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883009408:0@lo:501: 00000100:00100000:0.0:1789760595.254248:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760595.254283:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df27ce93540 going to sleep for 11 seconds 00000100:00100000:3.0:1789760595.254332:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883009408 00000100:00100000:3.0:1789760595.254336:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883009408 00000100:00100000:3.0:1789760595.254365:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789760595.254373:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247886850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+14:5842:x1876699883009408:12345-0@lo:501: 00000100:00100000:3.0:1789760595.254642:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247886850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+14:5842:x1876699883009408:12345-0@lo:501: Request processed in 261us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760595.254789:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789760595.255055:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277cda300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883009408:0@lo:501: 00000100:00100000:0.0:1789760595.255085:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277cda300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883009536:0@lo:503: 00000100:00100000:0.0:1789760595.255126:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760595.255151:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df27ce93540 going to sleep for 11 seconds 00000100:00100000:2.0:1789760595.255223:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883009536 00000100:00100000:2.0:1789760595.255228:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883009536 00000100:00100000:2.0:1789760595.255262:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789760595.255271:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247885c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+14:5842:x1876699883009536:12345-0@lo:503: 00000100:00100000:2.0:1789760595.255433:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247885c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+14:5842:x1876699883009536:12345-0@lo:503: Request processed in 163us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760595.255440:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789760595.255560:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277cda300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883009536:0@lo:503: 00000100:00100000:1.0:1789760595.259043:0:8477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8477:1876699883009664:0@lo:502: 00000100:00100000:1.0:1789760595.259121:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760595.259159:0:8477:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df24f308f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789760595.259547:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883009664 00000100:00100000:3.0:1789760595.259554:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883009664 00000100:00100000:3.0:1789760595.259602:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789760595.259610:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+14:8477:x1876699883009664:12345-0@lo:502: 00000100:00100000:3.0:1789760595.259865:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+14:8477:x1876699883009664:12345-0@lo:502: Request processed in 255us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760595.259873:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789760595.260171:0:8477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8477:1876699883009664:0@lo:502: 00000020:01000000:1.0:1789760595.260202:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789760595.260211:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760595.260213:0:8477:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789760595.260217:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789760595.260249:0:8477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8477:1876699883009792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760595.260286:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760595.260318:0:8477:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df24f308f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789760595.260592:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883009792 00000100:00100000:2.0:1789760595.260598:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883009792 00000100:00100000:2.0:1789760595.260625:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789760595.260643:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247884050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+14:8477:x1876699883009792:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789760595.260792:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247884050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+14:8477:x1876699883009792:12345-0@lo:502:llog_process_th.0 Request processed in 159us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760595.260799:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789760595.261323:0:8477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8477:1876699883009792:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789760595.261346:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789760595.261351:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760595.261353:0:8477:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789760595.261357:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789760595.261527:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1789760595.261547:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789760595.261555:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df243a66400/0x3e099f5ef04adb94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adb9b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760595.261565:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8df243a66400/0x3e099f5ef04adb94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adb9b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760595.261573:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789760595.261576:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df2598cf000 from 39 10000000:01000000:0.0:1789760595.261579:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789760595.261612:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df243a67800/0x3e099f5ef04adba2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760595.261619:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8df243a67800/0x3e099f5ef04adba2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760595.261629:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8df243a67800/0x3e099f5ef04adba2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760595.261663:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277cd9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883009920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789760595.261696:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760595.261731:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df27ce93c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789760595.262199:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883009920 00000100:00100000:3.0:1789760595.262204:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883009920 00000100:00100000:3.0:1789760595.262244:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789760595.262253:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247886450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+14:5842:x1876699883009920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789760595.262264:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760595.262283:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df2778e8800/0x3e099f5ef04adba9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04adba2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760595.262305:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df2778e8800/0x3e099f5ef04adba9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04adba2 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760595.262314:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df2778e8800/0x3e099f5ef04adba9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04adba2 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760595.262321:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2778e8800, rc 0) 00000100:00100000:3.0:1789760595.262366:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247886450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+15:5842:x1876699883009920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760595.262372:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789760595.262455:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277cd9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883009920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789760595.262467:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8df243a67800/0x3e099f5ef04adba2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adba9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760595.262475:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8df243a67800/0x3e099f5ef04adba2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04adba9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760595.262520:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883010048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789760595.262550:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760595.262581:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df24f308f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789760595.262834:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883010048 00000100:00100000:3.0:1789760595.262839:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883010048 00000100:00100000:3.0:1789760595.262869:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789760595.262876:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+15:5842:x1876699883010048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789760595.263121:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+15:5842:x1876699883010048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760595.263127:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789760595.263858:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883010048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789760595.263900:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883010176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789760595.263945:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760595.263988:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df24f308f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789760595.264236:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883010176 00000100:00100000:2.0:1789760595.264243:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883010176 00000100:00100000:2.0:1789760595.264272:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789760595.264280:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247886c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+15:5842:x1876699883010176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789760595.264447:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247886c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+15:5842:x1876699883010176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760595.264461:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789760595.267530:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883010176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789760595.268242:0:8478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747f8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8478:1876699883010304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789760595.268320:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760595.268368:0:8478:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df250f3fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789760595.268430:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883010304 00000100:00100000:2.0:1789760595.268437:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883010304 00000100:00100000:2.0:1789760595.268485:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789760595.268494:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247887050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+15:8478:x1876699883010304:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789760595.268741:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247887050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+15:8478:x1876699883010304:12345-0@lo:502:llog_process_th.0 Request processed in 247us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760595.268749:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789760595.268898:0:8478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747f8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8478:1876699883010304:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760595.268941:0:8478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8478:1876699883010432:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760595.268998:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760595.269018:0:8478:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df24f308f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789760595.269474:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883010432 00000100:00100000:2.0:1789760595.269479:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883010432 00000100:00100000:2.0:1789760595.269502:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789760595.269509:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247885450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+15:8478:x1876699883010432:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789760595.269683:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247885450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+15:8478:x1876699883010432:12345-0@lo:502:llog_process_th.0 Request processed in 173us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760595.269690:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789760595.269831:0:8478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8478:1876699883010432:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789760595.269863:0:8478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789760595.270431:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789760595.270450:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789760595.270459:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df243a67800/0x3e099f5ef04adba2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adba9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760595.270469:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8df243a67800/0x3e099f5ef04adba2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adba9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760595.270478:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789760595.270480:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1789760595.270483:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789760595.270508:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241539400/0x3e099f5ef04adbb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760595.270524:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8df241539400/0x3e099f5ef04adbb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760595.270534:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8df241539400/0x3e099f5ef04adbb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760595.270551:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d3f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883010560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789760595.270597:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760595.270769:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883010560 00000100:00100000:3.0:1789760595.270775:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883010560 00000100:00100000:3.0:1789760595.270831:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789760595.270840:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247887850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+15:5842:x1876699883010560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789760595.270932:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760595.270951:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df2778e9800/0x3e099f5ef04adbb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04adbb0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760595.270984:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df2778e9800/0x3e099f5ef04adbb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04adbb0 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760595.270999:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df2778e9800/0x3e099f5ef04adbb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04adbb0 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760595.271008:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2778e9800, rc 0) 00000100:00100000:3.0:1789760595.271038:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247887850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+16:5842:x1876699883010560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760595.271044:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789760595.271311:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df24574dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760595.271329:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d3f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883010560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789760595.271341:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8df241539400/0x3e099f5ef04adbb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adbb7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760595.271350:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8df241539400/0x3e099f5ef04adbb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04adbb7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760595.271394:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d3f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883010688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760595.271430:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760595.271449:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df24574dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789760595.271607:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883010688 00000100:00100000:0.0:1789760595.271612:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883010688 00000100:00100000:0.0:1789760595.271656:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789760595.271665:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247884c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+16:5842:x1876699883010688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789760595.271929:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247884c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+16:5842:x1876699883010688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760595.271936:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789760595.272154:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d3f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883010688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789760595.272185:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883010816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789760595.272223:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760595.274129:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df24f308f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789760595.274275:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883010816 00000100:00100000:3.0:1789760595.274283:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883010816 00000100:00100000:3.0:1789760595.274323:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789760595.274331:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247885050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+16:5842:x1876699883010816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789760595.274549:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247885050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+16:5842:x1876699883010816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 218us (2325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760595.274557:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789760595.281066:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883010816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789760595.284883:0:8479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8479:1876699883010944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760595.284966:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760595.285005:0:8479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df24f308c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789760595.285164:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883010944 00000100:00100000:3.0:1789760595.285171:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883010944 00000100:00100000:3.0:1789760595.285207:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789760595.285216:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+16:8479:x1876699883010944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789760595.285441:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+16:8479:x1876699883010944:12345-0@lo:502:llog_process_th.0 Request processed in 225us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760595.285449:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789760595.285622:0:8479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8479:1876699883010944:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789760595.285658:0:8479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789760595.285667:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760595.285669:0:8479:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789760595.285674:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789760595.285695:0:8479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8479:1876699883011072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760595.285729:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760595.285759:0:8479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df24f308c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789760595.286618:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883011072 00000100:00100000:3.0:1789760595.286631:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883011072 00000100:00100000:3.0:1789760595.286663:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789760595.286670:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247885850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+16:8479:x1876699883011072:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789760595.286855:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247885850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+16:8479:x1876699883011072:12345-0@lo:502:llog_process_th.0 Request processed in 178us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760595.286863:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789760595.286993:0:8479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8479:1876699883011072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789760595.287016:0:8479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789760595.287021:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760595.287023:0:8479:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789760595.287031:0:8479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1789760595.287619:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1789760595.287637:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789760595.287652:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241539400/0x3e099f5ef04adbb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adbb7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760595.287664:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8df241539400/0x3e099f5ef04adbb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adbb7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760595.287674:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789760595.287677:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df2457ba800 from 39 10000000:01000000:3.0:1789760595.287680:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789760595.287704:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df2778e8200/0x3e099f5ef04adbbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760595.287712:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8df2778e8200/0x3e099f5ef04adbbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760595.287720:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8df2778e8200/0x3e099f5ef04adbbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760595.287736:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883011200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789760595.287769:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760595.287824:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df250f3ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1789760595.287995:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883011200 00000100:00100000:1.0:1789760595.288001:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883011200 00000100:00100000:1.0:1789760595.288030:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789760595.288036:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+16:5842:x1876699883011200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789760595.288046:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760595.288057:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241487600/0x3e099f5ef04adbc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04adbbe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760595.288077:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241487600/0x3e099f5ef04adbc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04adbbe expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760595.288086:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241487600/0x3e099f5ef04adbc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04adbbe expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760595.288094:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241487600, rc 0) 00000100:00100000:1.0:1789760595.288126:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+17:5842:x1876699883011200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760595.288131:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789760595.288357:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883011200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789760595.288370:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8df2778e8200/0x3e099f5ef04adbbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adbc5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760595.288379:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8df2778e8200/0x3e099f5ef04adbbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04adbc5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760595.288442:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883011328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789760595.288470:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760595.288500:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df250f3ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1789760595.288613:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883011328 00000100:00100000:1.0:1789760595.288617:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883011328 00000100:00100000:1.0:1789760595.288636:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789760595.288642:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+17:5842:x1876699883011328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789760595.288908:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+17:5842:x1876699883011328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 265us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760595.288916:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789760595.289342:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883011328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789760595.289371:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883011456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789760595.289411:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760595.289451:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df250f3ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1789760595.289737:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883011456 00000100:00100000:1.0:1789760595.289742:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883011456 00000100:00100000:1.0:1789760595.289776:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789760595.289792:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+17:5842:x1876699883011456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789760595.289982:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+17:5842:x1876699883011456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760595.289990:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789760595.290401:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883011456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789760595.291135:0:8480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747f8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8480:1876699883011584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789760595.291194:0:8480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760595.291232:0:8480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df242e58c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789760595.291339:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883011584 00000100:00100000:1.0:1789760595.291344:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883011584 00000100:00100000:1.0:1789760595.291382:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789760595.291391:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+17:8480:x1876699883011584:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760595.291630:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+17:8480:x1876699883011584:12345-0@lo:502:llog_process_th.0 Request processed in 238us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760595.291637:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789760595.291876:0:8480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747f8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8480:1876699883011584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789760595.291921:0:8480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277cd9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8480:1876699883011712:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789760595.291956:0:8480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760595.291978:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883011712 00000100:00100000:0.0:1789760595.291982:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883011712 00000100:00100000:0.0:1789760595.292003:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789760595.292009:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+17:8480:x1876699883011712:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789760595.292136:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+17:8480:x1876699883011712:12345-0@lo:502:llog_process_th.0 Request processed in 126us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760595.292142:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789760595.292191:0:8480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df27ce93a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789760595.292203:0:8480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277cd9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8480:1876699883011712:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789760595.292222:0:8480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789760595.292561:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789760595.292577:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789760595.292596:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df2778e8200/0x3e099f5ef04adbbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adbc5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760595.292606:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8df2778e8200/0x3e099f5ef04adbbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adbc5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760595.292615:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789760595.292618:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1789760595.292621:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789760595.292647:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241487400/0x3e099f5ef04adbcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760595.292663:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8df241487400/0x3e099f5ef04adbcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760595.292673:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8df241487400/0x3e099f5ef04adbcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760595.292694:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883011840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789760595.292724:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760595.292736:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df24f308cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760595.293051:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883011840 00000100:00100000:3.0:1789760595.293056:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883011840 00000100:00100000:3.0:1789760595.293090:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789760595.293097:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+17:5842:x1876699883011840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789760595.293106:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760595.293117:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df2778e9400/0x3e099f5ef04adbd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04adbcc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760595.293156:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df2778e9400/0x3e099f5ef04adbd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04adbcc expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760595.293166:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df2778e9400/0x3e099f5ef04adbd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04adbcc expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760595.293184:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2778e9400, rc 0) 00000100:00100000:3.0:1789760595.293258:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+18:5842:x1876699883011840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760595.293264:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789760595.295052:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883011840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789760595.295074:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8df241487400/0x3e099f5ef04adbcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adbd3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760595.295086:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8df241487400/0x3e099f5ef04adbcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04adbd3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760595.295187:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d3f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883011968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760595.295236:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760595.295266:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df24574dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760595.295451:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883011968 00000100:00100000:3.0:1789760595.295457:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883011968 00000100:00100000:3.0:1789760595.295502:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789760595.295511:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+18:5842:x1876699883011968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789760595.296123:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+18:5842:x1876699883011968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 612us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760595.296132:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789760595.296234:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d3f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883011968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760595.296270:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d3f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883012096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789760595.296308:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760595.296370:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df24574dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760595.300084:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883012096 00000100:00100000:1.0:1789760595.300097:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883012096 00000100:00100000:1.0:1789760595.300162:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789760595.300249:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+18:5842:x1876699883012096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789760595.300625:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+18:5842:x1876699883012096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 453us (4314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760595.300633:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789760595.304161:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d3f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883012096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789760595.304740:0:8481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8481:1876699883012224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789760595.304845:0:8481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760595.304894:0:8481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259a68240 going to sleep for 11 seconds 00000100:00100000:2.0:1789760595.305155:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883012224 00000100:00100000:2.0:1789760595.305162:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883012224 00000100:00100000:2.0:1789760595.305541:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789760595.305550:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+18:8481:x1876699883012224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789760595.305832:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+18:8481:x1876699883012224:12345-0@lo:502:llog_process_th.0 Request processed in 282us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760595.305839:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789760595.307323:0:8481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8481:1876699883012224:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789760595.307358:0:8481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789760595.307367:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760595.307369:0:8481:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789760595.307376:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789760595.307402:0:8481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8481:1876699883012352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789760595.307466:0:8481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760595.307502:0:8481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259a68240 going to sleep for 11 seconds 00000100:00100000:1.0:1789760595.307552:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883012352 00000100:00100000:1.0:1789760595.307557:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883012352 00000100:00100000:1.0:1789760595.307595:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789760595.307603:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+18:8481:x1876699883012352:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760595.307787:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+18:8481:x1876699883012352:12345-0@lo:502:llog_process_th.0 Request processed in 184us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760595.307794:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789760595.308089:0:8481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8481:1876699883012352:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789760595.308107:0:8481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789760595.308111:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760595.308112:0:8481:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789760595.308117:0:8481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1789760595.308251:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1789760595.308269:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789760595.308278:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241487400/0x3e099f5ef04adbcc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adbd3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760595.308288:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8df241487400/0x3e099f5ef04adbcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adbd3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760595.308298:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789760595.308305:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8df2598e3370 from 1 10000000:01000000:1.0:1789760595.308308:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789760595.308330:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241486200/0x3e099f5ef04adbda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760595.308338:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8df241486200/0x3e099f5ef04adbda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760595.308346:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8df241486200/0x3e099f5ef04adbda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760595.308358:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883012480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789760595.308383:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760595.308448:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df24f3086c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789760595.308582:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883012480 00000100:00100000:0.0:1789760595.309095:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883012480 00000100:00100000:1.0:1789760595.314036:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789760595.314061:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+18:5842:x1876699883012480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789760595.314077:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760595.314096:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241487800/0x3e099f5ef04adbe1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04adbda expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760595.314123:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241487800/0x3e099f5ef04adbe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04adbda expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760595.314133:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241487800/0x3e099f5ef04adbe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04adbda expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760595.314141:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241487800, rc 0) 00000100:00100000:1.0:1789760595.314226:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:5842:x1876699883012480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (5840us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760595.314232:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789760595.314346:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883012480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789760595.314365:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8df241486200/0x3e099f5ef04adbda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adbe1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760595.314374:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8df241486200/0x3e099f5ef04adbda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04adbe1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760595.315121:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277cd9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883012608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789760595.315163:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760595.320584:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df27ce93a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789760595.321218:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883012608 00000100:00100000:3.0:1789760595.321229:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883012608 00000100:00100000:3.0:1789760595.321285:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789760595.321294:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+19:5842:x1876699883012608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789760595.321593:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+19:5842:x1876699883012608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (6419us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789760595.321601:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789760595.321611:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277cd9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883012608:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789760595.321708:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789760595.321720:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241486200/0x3e099f5ef04adbda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adbe1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760595.321730:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8df241486200/0x3e099f5ef04adbda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adbe1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760596.178099:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760596.559847:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789760596.559869:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d3f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883012736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760596.559936:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760596.560270:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883012736 00000100:00100000:3.0:1789760596.560279:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883012736 00000100:00100000:3.0:1789760596.560347:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789760596.560357:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883012736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760596.560394:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760596.560462:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883012736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760596.560469:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1789760596.560508:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26d3f6a00 x1876699883012736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760612 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760596.560526:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d3f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883012736:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789760596.560605:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789760597.198998:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760598.095195:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1876699883013120:0@lo:400:kworker.0 00000100:00100000:1.0:1789760598.095262:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760598.095326:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789760598.095332:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876699883012992:0@lo:400:kworker.0 00000100:00100000:1.0:1789760598.095355:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760598.095369:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883013504:0@lo:400:kworker.0 00000100:00100000:1.0:1789760598.095390:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760598.095662:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883013120 00000100:00100000:0.0:1789760598.095670:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883013120 00000100:00100000:0.0:1789760598.095727:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883012992 00000100:00100000:0.0:1789760598.095731:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883012992 00000100:00100000:0.0:1789760598.095753:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789760598.095761:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876699883013120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760598.095829:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876699883013120:12345-0@lo:400:kworker.0 Request processed in 68us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760598.095836:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789760598.095854:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789760598.095860:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876699883012992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760598.095887:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876699883012992:12345-0@lo:400:kworker.0 Request processed in 27us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760598.095893:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789760598.095929:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883013248:0@lo:400:kworker.0 00000100:00100000:1.0:1789760598.096177:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1876699883013120:0@lo:400:kworker.0 00000100:00100000:1.0:1789760598.096197:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876699883012992:0@lo:400:kworker.0 00000100:00080000:2.0:1789760598.096253:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760598.096355:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699883012864:0@lo:400:kworker.0 00000100:00100000:3.0:1789760598.096415:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760598.096439:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1876699883013376:0@lo:400:kworker.0 00000100:00100000:3.0:1789760598.096461:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760598.096689:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883013376 00000100:00100000:2.0:1789760598.096700:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883013376 00000100:00100000:2.0:1789760598.096742:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789760598.096750:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876699883013376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760598.096785:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876699883013376:12345-0@lo:400:kworker.0 Request processed in 37us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760598.096792:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789760598.096869:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883013504 00000100:00100000:0.0:1789760598.096874:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883013504 00000100:00100000:0.0:1789760598.096924:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789760598.096931:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883013504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760598.097157:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883012864 00000100:00100000:1.0:1789760598.097161:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883012864 00000100:00100000:1.0:1789760598.097185:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789760598.097192:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3311:x1876699883012864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760598.097225:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3311:x1876699883012864:12345-0@lo:400:kworker.0 Request processed in 33us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760598.097231:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:3.0:1789760598.097288:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789760598.097292:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760598.097312:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699883012864:0@lo:400:kworker.0 00000100:00100000:3.0:1789760598.097322:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1876699883013376:0@lo:400:kworker.0 00000100:00100000:2.0:1789760598.102453:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760598.105620:0:6695:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789760598.105638:0:6695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789760598.105736:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883013248 00000100:00100000:1.0:1789760598.105744:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883013248 00000100:00100000:1.0:1789760598.105794:0:6695:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789760598.105815:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789760598.105844:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883013248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760598.105933:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883013248:12345-0@lo:400:kworker.0 Request processed in 100us (3488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760598.105940:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1789760598.108993:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789760598.109064:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df2747b6d80 x1876699883013248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760598.109080:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883013248:0@lo:400:kworker.0 00000100:00100000:0.0:1789760598.125266:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883013504:12345-0@lo:400:kworker.0 Request processed in 28318us (29856us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760598.125282:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1789760598.125667:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df2747b7100 x1876699883013504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760598.125684:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883013504:0@lo:400:kworker.0 00010000:00010000:3.0:1789760598.223872:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760598.613273:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883013632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760598.613353:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760598.613541:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883013632 00000100:00100000:3.0:1789760598.613550:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883013632 00000100:00100000:3.0:1789760598.613596:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789760598.613605:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883013632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789760598.613644:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760598.613698:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883013632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760598.613705:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1789760598.613841:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df2747faa00 x1876699883013632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760614 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760598.613859:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883013632:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789760599.247452:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760599.672303:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760599.672400:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863061376 00000100:00100000:3.0:1789760599.672410:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863061376 00000100:00100000:3.0:1789760599.672472:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 166 00000100:00100000:3.0:1789760599.672483:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+8:5588:x1876699863061376:12345-192.168.203.12@tcp:101: 00010000:00010000:3.0:1789760599.672610:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760599.672644:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df2778e8600/0x3e099f5ef04adbe8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2cf5e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760599.672673:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df2778e8600/0x3e099f5ef04adbe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cf5e expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760599.672684:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df2778e8600/0x3e099f5ef04adbe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cf5e expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760599.672693:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2778e8600, rc 0) 00000100:00100000:3.0:1789760599.672754:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+9:5588:x1876699863061376:12345-192.168.203.12@tcp:101: Request processed in 273us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760599.672761:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 166 00000100:00100000:0.0:1789760599.705644:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760599.706044:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863061504 00000100:00100000:3.0:1789760599.706064:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863061504 00000100:00100000:3.0:1789760599.706145:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 167 00000100:00100000:3.0:1789760599.706161:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+9:5588:x1876699863061504:12345-192.168.203.12@tcp:501: 00000100:00100000:3.0:1789760599.706549:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+9:5588:x1876699863061504:12345-192.168.203.12@tcp:501: Request processed in 392us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760599.706558:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 167 00000100:00100000:0.0:1789760599.717576:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760599.718140:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863061632 00000100:00100000:1.0:1789760599.718156:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863061632 00000100:00100000:1.0:1789760599.718235:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 168 00000100:00100000:1.0:1789760599.718248:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+9:5588:x1876699863061632:12345-192.168.203.12@tcp:503: 00000100:00100000:1.0:1789760599.719721:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+9:5588:x1876699863061632:12345-192.168.203.12@tcp:503: Request processed in 1467us (2153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760599.719732:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 168 00000100:00100000:0.0:1789760599.731398:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760599.731595:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863061760 00000100:00100000:3.0:1789760599.731613:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863061760 00000100:00100000:3.0:1789760599.731684:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 169 00000100:00100000:3.0:1789760599.731697:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+9:6084:x1876699863061760:12345-192.168.203.12@tcp:502: 00000100:00100000:3.0:1789760599.732161:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+9:6084:x1876699863061760:12345-192.168.203.12@tcp:502: Request processed in 464us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760599.732170:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 169 00000100:00100000:0.0:1789760599.741350:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760599.744623:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863061888 00000100:00100000:1.0:1789760599.744644:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863061888 00000100:00100000:1.0:1789760599.744737:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 170 00000100:00100000:1.0:1789760599.744749:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+9:6084:x1876699863061888:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789760599.746249:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+9:6084:x1876699863061888:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 1491us (4901us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760599.746266:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 170 00000100:00100000:1.0:1789760599.767114:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760599.767221:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863062016 00000100:00100000:0.0:1789760599.767235:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863062016 00000100:00100000:0.0:1789760599.767314:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 171 00000100:00100000:0.0:1789760599.767325:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247857c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+9:5588:x1876699863062016:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789760599.767346:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760599.767370:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df243a67400/0x3e099f5ef04adbef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2cf65 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760599.767416:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df243a67400/0x3e099f5ef04adbef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cf65 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760599.767430:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df243a67400/0x3e099f5ef04adbef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cf65 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760599.767441:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df243a67400, rc 0) 00000100:00100000:0.0:1789760599.767522:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247857c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:5588:x1876699863062016:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 198us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760599.767531:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 171 00000100:00100000:2.0:1789760599.770743:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760599.770824:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863062144 00000100:00100000:1.0:1789760599.770834:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863062144 00000100:00100000:1.0:1789760599.770904:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 172 00000100:00100000:1.0:1789760599.770925:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247856450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:5588:x1876699863062144:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789760599.771221:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247856450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:5588:x1876699863062144:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 299us (486us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789760599.771230:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 172 00000100:00100000:0.0:1789760600.180080:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760600.180720:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863062272 00000100:00100000:3.0:1789760600.181006:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863062272 00000100:00100000:3.0:1789760600.181095:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 173 00000100:00100000:3.0:1789760600.183526:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247854850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:2351:x1876699863062272:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760600.183666:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247854850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:2351:x1876699863062272:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 2554us (3601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760600.183679:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 173 00000100:00100000:0.0:1789760600.187333:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760600.187412:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760600.187508:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760600.187931:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863062528 00000100:00100000:1.0:1789760600.187944:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863062528 00000100:00100000:1.0:1789760600.188028:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863062656 00000100:00100000:1.0:1789760600.188031:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863062656 00000100:00100000:1.0:1789760600.188055:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:1.0:1789760600.188066:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863062528:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1789760600.188163:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863062528:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 99us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760600.188171:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:1.0:1789760600.188189:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:1.0:1789760600.188195:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863062656:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1789760600.188214:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863062656:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 20us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760600.188220:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:3.0:1789760600.188525:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863062400 00000100:00100000:3.0:1789760600.188531:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863062400 00000100:00100000:3.0:1789760600.188573:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:3.0:1789760600.188580:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863062400:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760600.188991:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863062400:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 409us (1578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760600.189000:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00080000:0.0:1789760600.189467:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789760600.189476:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789760600.189479:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789760600.271392:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760601.303486:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760601.679207:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d3f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883013760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789760601.679322:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760601.680484:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883013760 00000100:00100000:0.0:1789760601.680497:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883013760 00000100:00100000:0.0:1789760601.680563:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789760601.680573:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883013760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789760601.680606:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760601.680686:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883013760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (1363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760601.680693:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1789760601.680908:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26d3f5f80 x1876699883013760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760617 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760601.680936:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d3f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883013760:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789760601.682327:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1789760601.920058:0:8521:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb6b45d20 20000000:00000080:1.0:1789760601.920075:0:8521:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df26d333800 uarg=0000000000000000 20000000:01000000:1.0:1789760601.920105:0:8521:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789760601.920110:0:8521:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789760601.920114:0:8521:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789760601.925857:0:8522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1789760601.925978:0:8521:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1789760601.942460:0:8521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1789760601.942538:0:8521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1789760601.942646:0:8521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1789760601.945340:0:8521:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789760601.945457:0:8521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df241539800/0x3e099f5ef04adbf6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760601.945481:0:8521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df241674a00/0x3e099f5ef04ad9bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ad9b8 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760601.945489:0:8521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df241487200/0x3e099f5ef04ada3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ada36 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760601.945497:0:8521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df243a66a00/0x3e099f5ef04ada98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04ada91 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760601.945506:0:8521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df241538c00/0x3e099f5ef04adb55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cf2d expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760601.945530:0:8521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df241539800/0x3e099f5ef04adbf6 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760601.945570:0:8521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df241538c00/0x3e099f5ef04adb55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cf2d expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760601.945584:0:8521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df241538c00/0x3e099f5ef04adb55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cf2d expref: 9 pid: 5838 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760601.945597:0:8521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d3f6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1876699883013888:192.168.203.12@tcp:104: 00010000:00010000:2.0:1789760601.945695:0:8521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df243a66a00/0x3e099f5ef04ada98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e099f5ef04ada91 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760601.945703:0:8521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df243a66a00/0x3e099f5ef04ada98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e099f5ef04ada91 expref: 18 pid: 5838 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760601.945712:0:8521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d3f5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1876699883014016:0@lo:104: 00000100:00100000:2.0:1789760601.945747:0:8521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789760601.945786:0:8521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df241487200/0x3e099f5ef04ada3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e099f5ef04ada36 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760601.945794:0:8521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df241487200/0x3e099f5ef04ada3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e099f5ef04ada36 expref: 18 pid: 5837 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760601.945823:0:8521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d3f4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1876699883014144:0@lo:104: 00000100:00100000:2.0:1789760601.945844:0:8521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789760601.945864:0:8521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df241674a00/0x3e099f5ef04ad9bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e099f5ef04ad9b8 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760601.945881:0:8521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df241674a00/0x3e099f5ef04ad9bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e099f5ef04ad9b8 expref: 18 pid: 5837 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760601.945889:0:8521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d3f7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1876699883014272:0@lo:104: 00000100:00100000:2.0:1789760601.945907:0:8521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259a80780 going to sleep for 11 seconds 00000100:00100000:1.0:1789760601.945991:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789760601.946013:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760601.946023:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883014016 00000100:00100000:1.0:1789760601.946030:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883014016 00000100:00100000:1.0:1789760601.946079:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883014144 00000100:00100000:1.0:1789760601.946083:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883014144 00000100:00100000:1.0:1789760601.946093:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883014272 00000100:00100000:1.0:1789760601.946095:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883014272 00000100:00100000:1.0:1789760601.946107:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789760601.946115:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e2780560-8e82-4256-94b0-2e524f3bed06+5:8521:x1876699883014016:12345-0@lo:104: 00010000:00010000:1.0:1789760601.946126:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8df241674e00/0x3e099f5ef04ada91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ada98 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760601.946172:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789760601.946177:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e2780560-8e82-4256-94b0-2e524f3bed06+5:8521:x1876699883014016:12345-0@lo:104: Request processed in 63us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760601.946183:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789760601.946199:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789760601.946204:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2779be050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e2780560-8e82-4256-94b0-2e524f3bed06+4:8521:x1876699883014144:12345-0@lo:104: 00010000:00010000:1.0:1789760601.946210:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8df241486e00/0x3e099f5ef04ada36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ada3d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760601.946235:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789760601.946240:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2779be050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e2780560-8e82-4256-94b0-2e524f3bed06+4:8521:x1876699883014144:12345-0@lo:104: Request processed in 36us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760601.946246:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789760601.946274:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789760601.946279:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e2780560-8e82-4256-94b0-2e524f3bed06+3:8521:x1876699883014272:12345-0@lo:104: 00010000:00010000:1.0:1789760601.946285:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8df241675c00/0x3e099f5ef04ad9b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ad9bf expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760601.946320:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789760601.946325:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e2780560-8e82-4256-94b0-2e524f3bed06+3:8521:x1876699883014272:12345-0@lo:104: Request processed in 46us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760601.946331:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1789760601.946345:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789760601.946350:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8df241674e00/0x3e099f5ef04ada91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ada98 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760601.946358:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674e00 already unused, calling callback (ffffffffc1be8c20) 10000000:00010000:1.0:1789760601.946362:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8df241674e00/0x3e099f5ef04ada91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e099f5ef04ada98 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760601.946385:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8df241674e00/0x3e099f5ef04ada91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e099f5ef04ada98 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789760601.946393:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8df241674e00/0x3e099f5ef04ada91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e099f5ef04ada98 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760601.946398:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789760601.946421:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8df241674e00/0x3e099f5ef04ada91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ada98 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760601.946427:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789760601.946445:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8df241674e00/0x3e099f5ef04ada91 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ada98 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760601.946451:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8df241674e00/0x3e099f5ef04ada91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ada98 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760601.946473:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789760601.946477:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8df241486e00/0x3e099f5ef04ada36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ada3d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760601.946482:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241486e00 already unused, calling callback (ffffffffc1be8c20) 10000000:00010000:1.0:1789760601.946485:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8df241486e00/0x3e099f5ef04ada36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e099f5ef04ada3d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760601.946493:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8df241486e00/0x3e099f5ef04ada36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e099f5ef04ada3d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789760601.946499:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8df241486e00/0x3e099f5ef04ada36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e099f5ef04ada3d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760601.946505:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789760601.946515:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8df241486e00/0x3e099f5ef04ada36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ada3d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760601.946520:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789760601.946532:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8df241486e00/0x3e099f5ef04ada36 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ada3d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760601.946539:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8df241486e00/0x3e099f5ef04ada36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ada3d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760601.946548:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789760601.946551:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8df241675c00/0x3e099f5ef04ad9b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04ad9bf expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760601.946565:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241675c00 already unused, calling callback (ffffffffc1be8c20) 10000000:00010000:1.0:1789760601.946568:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8df241675c00/0x3e099f5ef04ad9b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e099f5ef04ad9bf expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760601.946575:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8df241675c00/0x3e099f5ef04ad9b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e099f5ef04ad9bf expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789760601.946581:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8df241675c00/0x3e099f5ef04ad9b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e099f5ef04ad9bf expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760601.946586:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789760601.946596:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8df241675c00/0x3e099f5ef04ad9b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ad9bf expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760601.946601:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789760601.946607:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8df241675c00/0x3e099f5ef04ad9b8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ad9bf expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760601.946613:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8df241675c00/0x3e099f5ef04ad9b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04ad9bf expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760601.946625:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760601.946627:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760601.946629:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760601.946635:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760601.946645:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699883014400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789760601.946671:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760601.946707:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e2780560-8e82-4256-94b0-2e524f3bed06:3309:1876699883014656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789760601.946736:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760601.946752:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789760601.946757:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e2780560-8e82-4256-94b0-2e524f3bed06:3309:1876699883014528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789760601.946772:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760601.946791:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883014400 00000100:00100000:1.0:1789760601.946794:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883014400 00010000:00010000:1.0:1789760601.946829:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df243a66a00/0x3e099f5ef04ada98 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ada91 expref: 19 pid: 5838 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760601.946847:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883014656 00000100:00100000:1.0:1789760601.946850:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883014656 00010000:00010000:1.0:1789760601.946859:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df241674a00/0x3e099f5ef04ad9bf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ad9b8 expref: 20 pid: 5837 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760601.946868:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883014528 00000100:00100000:1.0:1789760601.946870:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883014528 00010000:00010000:1.0:1789760601.946877:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df241487200/0x3e099f5ef04ada3d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ada36 expref: 21 pid: 5837 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760601.946888:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789760601.946893:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2780560-8e82-4256-94b0-2e524f3bed06+21:3311:x1876699883014400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789760601.946901:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760601.946905:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df243a66a00/0x3e099f5ef04ada98 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ada91 expref: 21 pid: 5838 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760601.946914:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df243a66a00/0x3e099f5ef04ada98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e099f5ef04ada91 expref: 21 pid: 5838 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760601.946927:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760601.946949:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2780560-8e82-4256-94b0-2e524f3bed06+21:3311:x1876699883014400:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760601.946960:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789760601.946974:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789760601.946979:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2780560-8e82-4256-94b0-2e524f3bed06+20:3309:x1876699883014656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789760601.946986:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760601.946990:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df241674a00/0x3e099f5ef04ad9bf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ad9b8 expref: 20 pid: 5837 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760601.946997:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df241674a00/0x3e099f5ef04ad9bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e099f5ef04ad9b8 expref: 20 pid: 5837 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760601.947006:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760601.947031:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2780560-8e82-4256-94b0-2e524f3bed06+20:3309:x1876699883014656:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760601.947036:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789760601.947048:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789760601.947053:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3309:x1876699883014528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789760601.947060:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760601.947064:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df241487200/0x3e099f5ef04ada3d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04ada36 expref: 19 pid: 5837 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760601.947070:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df241487200/0x3e099f5ef04ada3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e099f5ef04ada36 expref: 19 pid: 5837 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760601.947078:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760601.947096:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3309:x1876699883014528:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760601.947101:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789760601.947135:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699883014400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789760601.947162:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e2780560-8e82-4256-94b0-2e524f3bed06:3309:1876699883014528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789760601.947169:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e2780560-8e82-4256-94b0-2e524f3bed06:3309:1876699883014656:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789760601.947796:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df243a66a00/0x3e099f5ef04ada98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e099f5ef04ada91 expref: 18 pid: 5838 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760601.947835:0:8521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d3f5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1876699883014016:0@lo:104: 00010000:00010000:2.0:1789760601.947845:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241487200/0x3e099f5ef04ada3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e099f5ef04ada36 expref: 17 pid: 5837 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760601.947854:0:8521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d3f4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1876699883014144:0@lo:104: 00010000:00010000:2.0:1789760601.947861:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241674a00/0x3e099f5ef04ad9bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e099f5ef04ad9b8 expref: 16 pid: 5837 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760601.947869:0:8521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d3f7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1876699883014272:0@lo:104: 00010000:00010000:0.0:1789760601.948030:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760601.955081:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760601.955094:0:8521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d3f6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1876699883013888:192.168.203.12@tcp:104: 00010000:00010000:2.0:1789760601.955132:0:8521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df241539800/0x3e099f5ef04adbf6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760601.956833:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863062784 00000100:00100000:3.0:1789760601.956844:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863062784 00010000:00010000:3.0:1789760601.956896:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df241538c00/0x3e099f5ef04adb55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cf2d expref: 10 pid: 5838 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760601.956931:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:3.0:1789760601.956940:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:2349:x1876699863062784:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789760601.956954:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760601.956959:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df241538c00/0x3e099f5ef04adb55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cf2d expref: 10 pid: 5838 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760601.956971:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df241538c00/0x3e099f5ef04adb55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cf2d expref: 10 pid: 5838 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760601.956989:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241538c00/0x3e099f5ef04adb55 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cf2d expref: 10 pid: 5838 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760601.957005:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df241539800/0x3e099f5ef04adbf6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760601.957014:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241539800/0x3e099f5ef04adbf6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760601.957029:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df241539800/0x3e099f5ef04adbf6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760601.957036:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df241539800/0x3e099f5ef04adbf6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760601.957042:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df241539800/0x3e099f5ef04adbf6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760601.957048:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df241539800/0x3e099f5ef04adbf6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760601.957071:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241539800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760601.957076:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df241539800/0x3e099f5ef04adbf6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760601.957083:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df241539800/0x3e099f5ef04adbf6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760601.957106:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df241539800/0x3e099f5ef04adbf6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760601.957117:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760601.957172:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:940dde3d-5669-46e3-a0d8-2c83dea985ec+9:2349:x1876699863062784:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 233us (2100us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760601.957180:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00010000:00010000:2.0:1789760601.958145:0:8521:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df241539800/0x3e099f5ef04adbf6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760601.958158:0:8521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df241539800/0x3e099f5ef04adbf6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760601.958165:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241539800/0x3e099f5ef04adbf6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760602.320011:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760603.187028:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760603.187066:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863062912 00000100:00100000:3.0:1789760603.187076:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863062912 00000100:00100000:3.0:1789760603.187128:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 174 00000100:00100000:3.0:1789760603.187139:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247856c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+9:5588:x1876699863062912:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789760603.187154:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760603.187173:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df2778e8a00/0x3e099f5ef04adbfd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2cf6c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760603.187201:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df2778e8a00/0x3e099f5ef04adbfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cf6c expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760603.187214:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df2778e8a00/0x3e099f5ef04adbfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cf6c expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760603.187237:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2778e8a00, rc 0) 00000100:00100000:3.0:1789760603.187290:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247856c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:5588:x1876699863062912:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 152us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760603.187297:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 174 00000100:00100000:0.0:1789760603.191985:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760603.193166:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863063040 00000100:00100000:3.0:1789760603.193178:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863063040 00000100:00100000:3.0:1789760603.193233:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 175 00000100:00100000:3.0:1789760603.193243:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247855450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:5588:x1876699863063040:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789760603.193532:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247855450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:5588:x1876699863063040:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 289us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760603.193541:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 175 00000100:00100000:0.0:1789760603.195444:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760603.195483:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863063168 00000100:00100000:3.0:1789760603.195490:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863063168 00000100:00100000:3.0:1789760603.195532:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 176 00000100:00100000:3.0:1789760603.195539:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247857050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:5588:x1876699863063168:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789760603.195745:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247857050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:5588:x1876699863063168:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 206us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760603.195751:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 176 00000100:00100000:0.0:1789760603.202549:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760603.202697:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863063296 00000100:00100000:3.0:1789760603.202707:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863063296 00000100:00100000:3.0:1789760603.202759:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 177 00000100:00100000:3.0:1789760603.202769:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247857850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:6142:x1876699863063296:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789760603.203157:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247857850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:6142:x1876699863063296:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 387us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760603.203175:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 177 00000100:00100000:3.0:1789760603.213773:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760603.214396:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863063424 00000100:00100000:0.0:1789760603.214407:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863063424 00000100:00100000:0.0:1789760603.214464:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 178 00000100:00100000:0.0:1789760603.214472:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247854c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:6142:x1876699863063424:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789760603.214694:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247854c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:6142:x1876699863063424:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 221us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760603.214702:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 178 00000100:00100000:2.0:1789760603.216084:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d3f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883014912:0@lo:400:kworker.0 00000100:00100000:2.0:1789760603.216140:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760603.216193:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d3f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883015424:0@lo:400:kworker.0 00000100:00100000:2.0:1789760603.216219:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760603.216252:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789760603.216259:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d3f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699883014784:0@lo:400:kworker.0 00000100:00100000:2.0:1789760603.216284:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760603.216304:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d3f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1876699883015296:0@lo:400:kworker.0 00000100:00100000:2.0:1789760603.216324:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760603.216349:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d3f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883015168:0@lo:400:kworker.0 00000100:00100000:2.0:1789760603.216383:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760603.216400:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789760603.216404:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d3f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1876699883015040:0@lo:400:kworker.0 00000100:00100000:2.0:1789760603.216421:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760603.216442:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883014912 00000100:00100000:2.0:1789760603.216446:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883014912 00000100:00100000:2.0:1789760603.216476:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883015296 00000100:00100000:2.0:1789760603.216479:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883015296 00000100:00100000:2.0:1789760603.216495:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883015040 00000100:00100000:2.0:1789760603.216497:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883015040 00000100:00100000:2.0:1789760603.216510:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789760603.216516:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883014912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760603.216555:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883014912:12345-0@lo:400:kworker.0 Request processed in 38us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760603.216561:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789760603.216582:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789760603.216587:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876699883015296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760603.216610:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876699883015296:12345-0@lo:400:kworker.0 Request processed in 23us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760603.216615:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789760603.216624:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789760603.216629:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876699883015040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760603.216649:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876699883015040:12345-0@lo:400:kworker.0 Request processed in 20us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760603.216655:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789760603.216668:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883015424 00000100:00100000:2.0:1789760603.216671:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883015424 00000100:00100000:2.0:1789760603.216691:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883015168 00000100:00100000:2.0:1789760603.216692:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883015168 00000100:00100000:2.0:1789760603.216706:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789760603.216711:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883015424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760603.216733:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883015424:12345-0@lo:400:kworker.0 Request processed in 23us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760603.216739:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789760603.216747:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789760603.216751:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883015168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760603.216769:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883015168:12345-0@lo:400:kworker.0 Request processed in 18us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760603.216774:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1789760603.216793:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789760603.216796:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789760603.216798:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760603.216846:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d3f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1876699883015040:0@lo:400:kworker.0 00010000:00080000:2.0:1789760603.216857:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26d3f5880 x1876699883015168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760603.216867:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d3f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883015168:0@lo:400:kworker.0 00000100:00100000:2.0:1789760603.216963:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d3f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1876699883015296:0@lo:400:kworker.0 00000100:00100000:2.0:1789760603.216973:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d3f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883014912:0@lo:400:kworker.0 00010000:00080000:2.0:1789760603.216980:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26d3f6300 x1876699883015424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760603.216987:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d3f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883015424:0@lo:400:kworker.0 00000100:00100000:3.0:1789760603.217228:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883014784 00000100:00100000:3.0:1789760603.217233:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883014784 00000100:00100000:3.0:1789760603.217323:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789760603.217331:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247855050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+16:3311:x1876699883014784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760603.217384:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247855050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+16:3311:x1876699883014784:12345-0@lo:400:kworker.0 Request processed in 54us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760603.217391:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789760603.217431:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d3f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699883014784:0@lo:400:kworker.0 10000000:01000000:1.0:1789760603.279481:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789760603.279489:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df26cd8e800 from 4 10000000:01000000:1.0:1789760603.279494:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789760603.279537:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241486e00/0x3e099f5ef04adc04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760603.279549:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8df241486e00/0x3e099f5ef04adc04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760603.279562:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8df241486e00/0x3e099f5ef04adc04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760603.279587:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883015552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789760603.279649:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760603.279696:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df251e5db40 going to sleep for 11 seconds 00000100:00100000:3.0:1789760603.279744:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883015552 00000100:00100000:3.0:1789760603.279752:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883015552 00000100:00100000:3.0:1789760603.279830:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789760603.279840:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247857450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+16:5842:x1876699883015552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789760603.279854:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760603.279866:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df2778e8e00/0x3e099f5ef04adc0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04adc04 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760603.279887:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df2778e8e00/0x3e099f5ef04adc0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04adc04 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760603.279907:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df2778e8e00/0x3e099f5ef04adc0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04adc04 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760603.279917:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2778e8e00, rc 0) 00000100:00100000:3.0:1789760603.279959:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247857450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+17:5842:x1876699883015552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760603.279977:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789760603.282454:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883015552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789760603.282480:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8df241486e00/0x3e099f5ef04adc04 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adc0b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760603.282493:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8df241486e00/0x3e099f5ef04adc04 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04adc0b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760603.282566:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883015680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789760603.282624:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760603.282669:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df251e5db40 going to sleep for 11 seconds 00000100:00100000:0.0:1789760603.284198:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883015680 00000100:00100000:0.0:1789760603.284215:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883015680 00000100:00100000:0.0:1789760603.284264:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789760603.284272:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247855850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+17:5842:x1876699883015680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789760603.284521:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247855850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+17:5842:x1876699883015680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (1896us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760603.284528:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789760603.285198:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883015680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789760603.285245:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883015808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789760603.285285:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760603.285315:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df251e5db40 going to sleep for 11 seconds 00000100:00100000:0.0:1789760603.285409:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883015808 00000100:00100000:0.0:1789760603.285413:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883015808 00000100:00100000:0.0:1789760603.285440:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789760603.285447:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247854450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+17:5842:x1876699883015808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789760603.285599:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247854450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+17:5842:x1876699883015808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760603.285606:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789760603.289913:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883015808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789760603.296455:0:8570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747b5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8570:1876699883015936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760603.296554:0:8570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760603.296634:0:8570:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df251e5d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760603.301605:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883015936 00000100:00100000:2.0:1789760603.301623:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883015936 00000100:00100000:3.0:1789760603.301754:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789760603.301765:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247856050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+17:8570:x1876699883015936:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789760603.302276:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247856050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+17:8570:x1876699883015936:12345-0@lo:502:llog_process_th.0 Request processed in 512us (5721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760603.302285:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789760603.302353:0:8570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747b5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8570:1876699883015936:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789760603.302398:0:8570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789760603.302407:0:8570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760603.302410:0:8570:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789760603.302417:0:8570:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df26cd8e800 00000020:00000080:3.0:1789760603.302419:0:8570:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789760603.302499:0:8570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747fb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8570:1876699883016064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789760603.302540:0:8570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760603.302568:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883016064 00000100:00100000:3.0:1789760603.302573:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883016064 00000100:00100000:3.0:1789760603.302597:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789760603.302605:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247856850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+17:8570:x1876699883016064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789760603.302731:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247856850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+17:8570:x1876699883016064:12345-0@lo:502:llog_process_th.0 Request processed in 126us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760603.302738:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789760603.302781:0:8570:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df25a20c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789760603.302794:0:8570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747fb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8570:1876699883016064:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789760603.302841:0:8570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789760603.302845:0:8570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760603.302846:0:8570:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789760603.302850:0:8570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789760603.306501:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789760603.306549:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789760603.306561:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241486e00/0x3e099f5ef04adc04 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adc0b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760603.306576:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8df241486e00/0x3e099f5ef04adc04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adc0b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760603.306586:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789760603.306588:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df2598cf000 from 4 10000000:01000000:2.0:1789760603.306591:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789760603.306624:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241539e00/0x3e099f5ef04adc12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760603.306632:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8df241539e00/0x3e099f5ef04adc12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760603.306654:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8df241539e00/0x3e099f5ef04adc12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760603.306678:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d3f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883016192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789760603.306742:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760603.306788:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df25857d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760603.306875:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883016192 00000100:00100000:2.0:1789760603.306882:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883016192 00000100:00100000:2.0:1789760603.306940:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789760603.306949:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247855c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+17:5842:x1876699883016192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789760603.306962:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760603.306974:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241538e00/0x3e099f5ef04adc19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04adc12 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760603.306996:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241538e00/0x3e099f5ef04adc19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04adc12 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760603.307006:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241538e00/0x3e099f5ef04adc19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04adc12 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760603.307014:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241538e00, rc 0) 00000100:00100000:2.0:1789760603.307050:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247855c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+18:5842:x1876699883016192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760603.307056:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789760603.307095:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d3f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883016192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789760603.307108:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8df241539e00/0x3e099f5ef04adc12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adc19 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760603.307122:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8df241539e00/0x3e099f5ef04adc12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04adc19 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760603.307175:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d3f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883016320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760603.307200:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760603.307215:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df25857d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760603.307229:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883016320 00000100:00100000:2.0:1789760603.307232:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883016320 00000100:00100000:2.0:1789760603.307253:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789760603.307260:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247854050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+18:5842:x1876699883016320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760603.314233:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247854050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+18:5842:x1876699883016320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 6965us (7023us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760603.314248:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789760603.314370:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d3f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883016320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789760603.314427:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883016448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789760603.314477:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760603.314509:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df251e5d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760603.315867:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883016448 00000100:00100000:2.0:1789760603.315876:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883016448 00000100:00100000:2.0:1789760603.315937:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789760603.315947:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+18:5842:x1876699883016448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789760603.316152:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+18:5842:x1876699883016448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 206us (1674us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760603.316160:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789760603.316331:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883016448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789760603.317618:0:8572:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747b4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8572:1876699883016576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760603.317686:0:8572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760603.317717:0:8572:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df251e5d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789760603.317768:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883016576 00000100:00100000:2.0:1789760603.317774:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883016576 00000100:00100000:2.0:1789760603.317837:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789760603.317846:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258609050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+18:8572:x1876699883016576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789760603.318034:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258609050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+18:8572:x1876699883016576:12345-0@lo:502:llog_process_th.0 Request processed in 188us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760603.318047:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789760603.318096:0:8572:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747b4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8572:1876699883016576:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789760603.318122:0:8572:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789760603.318132:0:8572:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760603.318134:0:8572:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789760603.318141:0:8572:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df2598cf000 00000020:00000080:2.0:1789760603.318144:0:8572:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789760603.318582:0:8572:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d3f7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8572:1876699883016704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789760603.318619:0:8572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760603.318640:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883016704 00000100:00100000:2.0:1789760603.318644:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883016704 00000100:00100000:2.0:1789760603.318665:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789760603.318671:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25860b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+18:8572:x1876699883016704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789760603.318786:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25860b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+18:8572:x1876699883016704:12345-0@lo:502:llog_process_th.0 Request processed in 113us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760603.318793:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789760603.318843:0:8572:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df25857d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789760603.318858:0:8572:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d3f7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8572:1876699883016704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789760603.318876:0:8572:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789760603.318881:0:8572:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760603.318882:0:8572:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789760603.318886:0:8572:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789760603.318941:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789760603.318958:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789760603.318969:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241539e00/0x3e099f5ef04adc12 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adc19 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760603.318989:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8df241539e00/0x3e099f5ef04adc12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adc19 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760603.318998:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789760603.319000:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df2457ba800 from 4 10000000:01000000:2.0:1789760603.319002:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789760603.319023:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241539a00/0x3e099f5ef04adc20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760603.319031:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8df241539a00/0x3e099f5ef04adc20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760603.319039:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8df241539a00/0x3e099f5ef04adc20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760603.319051:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d3f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883016832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789760603.319078:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760603.319091:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259ab8840 going to sleep for 11 seconds 00000100:00100000:2.0:1789760603.319103:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883016832 00000100:00100000:2.0:1789760603.319106:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883016832 00000100:00100000:2.0:1789760603.319125:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789760603.319131:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+18:5842:x1876699883016832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789760603.319139:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760603.319149:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241539800/0x3e099f5ef04adc27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04adc20 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760603.319168:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241539800/0x3e099f5ef04adc27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04adc20 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760603.319188:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241539800/0x3e099f5ef04adc27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04adc20 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760603.319197:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241539800, rc 0) 00000100:00100000:2.0:1789760603.319229:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:5842:x1876699883016832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760603.319235:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789760603.319262:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d3f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883016832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789760603.319281:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8df241539a00/0x3e099f5ef04adc20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adc27 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760603.319290:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8df241539a00/0x3e099f5ef04adc20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04adc27 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760603.319330:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d3f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883016960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760603.319357:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760603.319399:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259ab8840 going to sleep for 11 seconds 00000100:00100000:2.0:1789760603.319411:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883016960 00000100:00100000:2.0:1789760603.319414:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883016960 00000100:00100000:2.0:1789760603.319435:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789760603.319443:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:5842:x1876699883016960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760603.319671:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:5842:x1876699883016960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 228us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760603.319677:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789760603.319708:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d3f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883016960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760603.319746:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d3f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883017088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789760603.319782:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760603.319797:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df25857d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760603.319855:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883017088 00000100:00100000:2.0:1789760603.319859:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883017088 00000100:00100000:2.0:1789760603.319877:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789760603.319882:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:5842:x1876699883017088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789760603.320003:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:5842:x1876699883017088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760603.320009:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789760603.320394:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d3f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883017088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789760603.328986:0:8575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277cdb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8575:1876699883017216:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789760603.329067:0:8575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760603.329116:0:8575:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df27ce93840 going to sleep for 11 seconds 00000100:00100000:2.0:1789760603.330240:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883017216 00000100:00100000:2.0:1789760603.330250:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883017216 00000100:00100000:2.0:1789760603.330303:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789760603.330312:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:8575:x1876699883017216:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789760603.330568:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:8575:x1876699883017216:12345-0@lo:502:llog_process_th.0 Request processed in 256us (1501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760603.330575:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789760603.331578:0:8575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277cdb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8575:1876699883017216:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789760603.331615:0:8575:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789760603.331624:0:8575:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760603.331626:0:8575:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789760603.331632:0:8575:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df2457ba800 00000020:00000080:1.0:1789760603.331635:0:8575:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789760603.331724:0:8575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8575:1876699883017344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760603.331783:0:8575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760603.331841:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883017344 00000100:00100000:1.0:1789760603.331846:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883017344 00000100:00100000:1.0:1789760603.334503:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1789760603.334520:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+19:8575:x1876699883017344:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789760603.334764:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+19:8575:x1876699883017344:12345-0@lo:502:llog_process_th.0 Request processed in 249us (2980us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760603.334772:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789760603.336219:0:8575:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df251e5d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789760603.336256:0:8575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e2780560-8e82-4256-94b0-2e524f3bed06:8575:1876699883017344:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789760603.336295:0:8575:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760603.336304:0:8575:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760603.336307:0:8575:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789760603.336312:0:8575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789760603.336553:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789760603.336578:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789760603.336590:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241539a00/0x3e099f5ef04adc20 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adc27 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760603.336600:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8df241539a00/0x3e099f5ef04adc20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adc27 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760603.350934:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760603.727250:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883017472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760603.727343:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760603.727550:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883017472 00000100:00100000:3.0:1789760603.727558:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883017472 00000100:00100000:3.0:1789760603.727627:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789760603.727638:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883017472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789760603.727682:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760603.727739:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883017472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760603.727746:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1789760603.727788:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df2747fb480 x1876699883017472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760619 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760603.729106:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883017472:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789760604.368949:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760605.302428:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760605.302473:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760605.302516:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760605.302544:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760605.302584:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863063552 00000100:00100000:0.0:1789760605.302594:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863063552 00000100:00100000:0.0:1789760605.302642:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 195 00000100:00100000:0.0:1789760605.302652:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:2350:x1876699863063552:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1789760605.302715:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:2350:x1876699863063552:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 64us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760605.302734:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 195 00000100:00100000:0.0:1789760605.302767:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863063936 00000100:00100000:0.0:1789760605.302772:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863063936 00000100:00100000:0.0:1789760605.302830:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863063808 00000100:00100000:0.0:1789760605.302834:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863063808 00000100:00100000:1.0:1789760605.302850:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:0.0:1789760605.302855:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:1.0:1789760605.302858:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863063936:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1789760605.302860:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863063808:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1789760605.302888:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863063808:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760605.302888:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863063936:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 32us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760605.302895:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00080000:0.0:1789760605.302915:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789760605.302919:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789760605.303025:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863063680 00000100:00100000:3.0:1789760605.303030:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863063680 00000100:00080000:0.0:1789760605.303418:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760605.303477:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:3.0:1789760605.303491:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863063680:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760605.303525:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863063680:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 39us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760605.303529:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:3.0:1789760605.303531:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 36 00010000:00010000:1.0:1789760605.391192:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760606.417041:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760606.799510:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789760606.799534:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277cd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883017600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789760606.799606:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760606.799672:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883017600 00000100:00100000:0.0:1789760606.799679:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883017600 00000100:00100000:0.0:1789760606.799732:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789760606.799741:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883017600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789760606.799782:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760606.799852:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883017600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760606.799860:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1789760606.799880:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789760606.799915:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df277cd8700 x1876699883017600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760622 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760606.799934:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277cd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883017600:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1789760607.428063:0:8821:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1789760607.439883:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760608.340944:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883018112:0@lo:400:kworker.0 00000100:00100000:1.0:1789760608.340982:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883017728:0@lo:400:kworker.0 00000100:00100000:2.0:1789760608.341030:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760608.341034:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760608.341088:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1876699883018240:0@lo:400:kworker.0 00000100:00100000:1.0:1789760608.341113:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760608.341140:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789760608.341145:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876699883017856:0@lo:400:kworker.0 00000100:00100000:1.0:1789760608.341161:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760608.341184:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883018368:0@lo:400:kworker.0 00000100:00100000:1.0:1789760608.341202:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760608.341223:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883018240 00000100:00100000:0.0:1789760608.341231:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883018240 00000100:00100000:1.0:1789760608.341235:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883017984:0@lo:400:kworker.0 00000100:00100000:1.0:1789760608.341256:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760608.341279:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883018112 00000100:00100000:3.0:1789760608.341284:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883018112 00000100:00100000:0.0:1789760608.341293:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883017856 00000100:00100000:1.0:1789760608.341295:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883017728 00000100:00100000:0.0:1789760608.341299:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883017856 00000100:00100000:1.0:1789760608.341301:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883017728 00000100:00100000:3.0:1789760608.341336:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883018368 00000100:00100000:0.0:1789760608.341339:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883017984 00000100:00100000:3.0:1789760608.341341:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883018368 00000100:00100000:0.0:1789760608.341344:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883017984 00000100:00100000:1.0:1789760608.341352:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789760608.341371:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789760608.341376:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883017728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760608.341384:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876699883018240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760608.341402:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789760608.341413:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883018112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760608.341430:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883017728:12345-0@lo:400:kworker.0 Request processed in 59us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760608.341439:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876699883018240:12345-0@lo:400:kworker.0 Request processed in 58us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760608.341440:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789760608.341451:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789760608.341464:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883018112:12345-0@lo:400:kworker.0 Request processed in 53us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760608.341474:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789760608.341474:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789760608.341483:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789760608.341488:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876699883017856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760608.341496:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789760608.341505:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883017984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760608.341510:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883018368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760608.341525:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876699883017856:12345-0@lo:400:kworker.0 Request processed in 41us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760608.341533:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1789760608.341555:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789760608.341561:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760608.341561:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883018368:12345-0@lo:400:kworker.0 Request processed in 56us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760608.341564:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883017984:12345-0@lo:400:kworker.0 Request processed in 62us (305us total) trans 0 rc 0/0 00000100:00080000:0.0:1789760608.341573:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760608.341577:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789760608.341578:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789760608.341633:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883017984:0@lo:400:kworker.0 00000100:00100000:1.0:1789760608.341654:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876699883017856:0@lo:400:kworker.0 00010000:00080000:1.0:1789760608.341671:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27cc78a80 x1876699883018368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760608.341680:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883018368:0@lo:400:kworker.0 00000100:00100000:1.0:1789760608.341687:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883017728:0@lo:400:kworker.0 00000100:00100000:1.0:1789760608.341694:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1876699883018240:0@lo:400:kworker.0 00010000:00080000:2.0:1789760608.345979:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26d716a00 x1876699883018112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760608.346062:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883018112:0@lo:400:kworker.0 00010000:00010000:0.0:1789760608.463543:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760608.847115:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789760608.847137:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277cd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883018496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760608.847202:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760608.847526:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883018496 00000100:00100000:3.0:1789760608.847543:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883018496 00000100:00100000:3.0:1789760608.847592:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789760608.847602:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883018496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789760608.847633:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760608.847689:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883018496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760608.847696:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1789760608.847724:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df277cd8700 x1876699883018496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760624 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760608.847743:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277cd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883018496:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789760609.489488:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760610.422698:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760610.422746:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760610.423054:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863064064 00000100:00100000:1.0:1789760610.423064:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863064064 00000100:00100000:1.0:1789760610.423124:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 197 00000100:00100000:1.0:1789760610.423134:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:2348:x1876699863064064:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1789760610.423198:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:2348:x1876699863064064:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 66us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760610.423205:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 197 00000100:00100000:2.0:1789760610.423286:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863064192 00000100:00100000:2.0:1789760610.423291:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863064192 00000100:00100000:2.0:1789760610.423376:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:2.0:1789760610.423384:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863064192:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1789760610.423417:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863064192:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 35us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760610.423423:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00080000:1.0:1789760610.423547:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760610.428034:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760610.428079:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760610.433340:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863064320 00000100:00100000:1.0:1789760610.433353:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863064448 00000100:00100000:3.0:1789760610.433355:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863064320 00000100:00100000:1.0:1789760610.433362:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863064448 00000100:00100000:1.0:1789760610.433452:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:1.0:1789760610.433463:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2347:x1876699863064448:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:1.0:1789760610.433503:0:6694:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e099f5ef04adb6a 00000100:00080000:1.0:1789760610.433513:0:6694:0:(import.c:65:import_set_state_nolock()) ffff8df2513d6000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789760610.433552:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789760610.434363:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+2:2347:x1876699863064448:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 898us (6280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760610.434384:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00080000:1.0:1789760610.434409:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789760610.434449:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760610.434564:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:2.0:1789760610.434573:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2347:x1876699863064320:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:2.0:1789760610.434599:0:6693:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e099f5ef04adb63 00000100:00080000:2.0:1789760610.434607:0:6693:0:(import.c:65:import_set_state_nolock()) ffff8df253567000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789760610.434654:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1789760610.434675:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789760610.435050:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+2:2347:x1876699863064320:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 477us (7025us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760610.435068:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00080000:1.0:1789760610.435288:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789760610.513288:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760611.538431:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760611.919963:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789760611.919988:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d3f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883018624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760611.920633:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760611.921225:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883018624 00000100:00100000:1.0:1789760611.921234:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883018624 00000100:00100000:1.0:1789760611.921313:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789760611.921324:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883018624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789760611.921358:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760611.921413:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883018624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760611.921420:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1789760611.921665:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789760611.925076:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26d3f6a00 x1876699883018624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760627 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760611.925106:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d3f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883018624:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1789760611.973442:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1da0113a-370d-4d79-883c-54efc174697f 00000020:00000080:0.0:1789760611.973452:0:6719:0:(genops.c:885:class_export_put()) final put ffff8df274a4f800/1da0113a-370d-4d79-883c-54efc174697f 00000020:00000080:0.0:1789760611.973480:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df274a4f800/1da0113a-370d-4d79-883c-54efc174697f for lustre-OST0000 00000020:00000080:0.0:1789760611.973744:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df253567000 for lustre-OST0000 00010000:00010000:2.0:1789760612.560651:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789760612.643072:0:9067:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing yml_node 00000100:00100000:3.0:1789760613.457479:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277cd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883018752:0@lo:400:kworker.0 00000100:00100000:3.0:1789760613.457618:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760613.457680:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277cdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1876699883019264:0@lo:400:kworker.0 00000100:00100000:3.0:1789760613.457724:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760613.457753:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789760613.457759:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277cda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876699883018880:0@lo:400:kworker.0 00000100:00100000:3.0:1789760613.457780:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760613.457798:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277cd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883019392:0@lo:400:kworker.0 00000100:00100000:3.0:1789760613.457849:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760613.457881:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883019264 00000100:00100000:3.0:1789760613.457888:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883019264 00000100:00100000:3.0:1789760613.457939:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883018880 00000100:00100000:3.0:1789760613.457943:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883018880 00000100:00100000:3.0:1789760613.457966:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789760613.457975:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876699883019264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760613.458237:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883018752 00000100:00100000:2.0:1789760613.458242:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883018752 00000100:00100000:2.0:1789760613.458276:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789760613.458303:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883018752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760613.458354:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883018752:12345-0@lo:400:kworker.0 Request processed in 52us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760613.458361:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789760613.458482:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876699883019264:12345-0@lo:400:kworker.0 Request processed in 508us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760613.458489:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789760613.458570:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789760613.458578:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876699883018880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760613.458613:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876699883018880:12345-0@lo:400:kworker.0 Request processed in 36us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760613.458619:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789760613.458640:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883019392 00000100:00100000:3.0:1789760613.458644:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883019392 00000100:00100000:3.0:1789760613.458681:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789760613.458688:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883019392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760613.458717:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883019392:12345-0@lo:400:kworker.0 Request processed in 30us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760613.458723:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1789760613.458746:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789760613.458750:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760613.458783:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277cda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876699883018880:0@lo:400:kworker.0 00010000:00080000:3.0:1789760613.458797:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df277cd8700 x1876699883019392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760613.458948:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277cd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883019392:0@lo:400:kworker.0 00000100:00100000:3.0:1789760613.458960:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277cd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883018752:0@lo:400:kworker.0 00000100:00100000:3.0:1789760613.458970:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277cdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1876699883019264:0@lo:400:kworker.0 00000100:00100000:0.0:1789760613.459079:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277cdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883019008:0@lo:400:kworker.0 00000100:00100000:0.0:1789760613.459111:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760613.459131:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789760613.459137:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277cd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883019136:0@lo:400:kworker.0 00000100:00100000:0.0:1789760613.459157:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760613.459300:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883019136 00000100:00100000:2.0:1789760613.459305:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883019136 00000100:00100000:2.0:1789760613.459358:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789760613.459365:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883019136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760613.459401:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883019136:12345-0@lo:400:kworker.0 Request processed in 38us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760613.459408:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1789760613.460471:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789760613.460519:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df277cd9f80 x1876699883019136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760613.460532:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277cd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883019136:0@lo:400:kworker.0 00000100:00100000:3.0:1789760613.460656:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883019008 00000100:00100000:3.0:1789760613.460661:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883019008 00000100:00100000:3.0:1789760613.460718:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789760613.460726:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883019008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760613.460787:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883019008:12345-0@lo:400:kworker.0 Request processed in 61us (1673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760613.460822:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789760613.460855:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277cdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883019008:0@lo:400:kworker.0 00000100:00080000:0.0:1789760613.461159:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789760613.583019:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760613.968535:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789760613.968561:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277cd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883019520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760613.968635:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760613.968709:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883019520 00000100:00100000:0.0:1789760613.968716:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883019520 00000100:00100000:0.0:1789760613.968768:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789760613.968777:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883019520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789760613.968845:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760613.968889:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883019520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760613.968897:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1789760613.968951:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df277cd9f80 x1876699883019520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760629 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760613.968968:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277cd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883019520:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1789760614.070006:0:7658:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1da0113a-370d-4d79-883c-54efc174697f 00000020:00000080:1.0:1789760614.070015:0:7658:0:(genops.c:885:class_export_put()) final put ffff8df27ead3800/1da0113a-370d-4d79-883c-54efc174697f 00000020:00000080:3.0:1789760614.070105:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df27ead3800/1da0113a-370d-4d79-883c-54efc174697f for lustre-OST0001 00000020:00000080:3.0:1789760614.070167:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df2513d6000 for lustre-OST0001 00010000:00010000:2.0:1789760614.608837:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760615.550321:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760615.550438:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863064576 00000100:00100000:3.0:1789760615.550450:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863064576 00000100:00100000:3.0:1789760615.550546:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 199 00000100:00100000:3.0:1789760615.550556:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:2351:x1876699863064576:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760615.550647:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:2351:x1876699863064576:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 92us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760615.550668:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 199 00000100:00100000:3.0:1789760615.558642:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760615.558878:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863064704 00000100:00100000:2.0:1789760615.558889:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863064704 00000100:00080000:0.0:1789760615.558926:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760615.559028:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:2.0:1789760615.559039:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863064704:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1789760615.559118:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863064704:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 80us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760615.559126:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00010000:00010000:2.0:1789760615.631151:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760616.655110:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760617.043237:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883019648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760617.043322:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760617.043500:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883019648 00000100:00100000:3.0:1789760617.043507:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883019648 00000100:00100000:3.0:1789760617.043570:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789760617.043580:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883019648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760617.043611:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760617.043656:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883019648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760617.043663:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1789760617.043731:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789760617.043759:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df2747f8e00 x1876699883019648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760617.043777:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883019648:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789760617.685347:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789760617.689908:0:9261:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.103 00000100:00100000:0.0:1789760618.575057:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277cdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883020032:0@lo:400:kworker.0 00000100:00100000:0.0:1789760618.575122:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760618.575183:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789760618.575190:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25847c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883020160:0@lo:400:kworker.0 00000100:00100000:0.0:1789760618.575215:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760618.575266:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883020032 00000100:00100000:0.0:1789760618.575273:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883020032 00000100:00100000:2.0:1789760618.575381:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277cda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883019904:0@lo:400:kworker.0 00000100:00100000:2.0:1789760618.575411:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760618.575430:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25847fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883020416:0@lo:400:kworker.0 00000100:00100000:2.0:1789760618.575464:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760618.575488:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789760618.575494:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277cd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699883019776:0@lo:400:kworker.0 00000100:00100000:2.0:1789760618.575520:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760618.575540:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25847f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1876699883020288:0@lo:400:kworker.0 00000100:00100000:2.0:1789760618.575562:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760618.575587:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883019904 00000100:00100000:2.0:1789760618.575591:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883019904 00000100:00100000:0.0:1789760618.575652:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883020288 00000100:00100000:0.0:1789760618.575657:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883020288 00000100:00100000:2.0:1789760618.576693:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789760618.576703:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25847e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883020032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760618.576930:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25847e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883020032:12345-0@lo:400:kworker.0 Request processed in 227us (1807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760618.576938:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789760618.576954:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789760618.576961:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883019904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760618.577004:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883019904:12345-0@lo:400:kworker.0 Request processed in 43us (1592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760618.577010:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789760618.577034:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883020160 00000100:00100000:2.0:1789760618.577039:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883020160 00000100:00100000:2.0:1789760618.577063:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883020416 00000100:00100000:2.0:1789760618.577066:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883020416 00000100:00100000:2.0:1789760618.577089:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789760618.577095:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25847dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883020160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760618.577126:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25847dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883020160:12345-0@lo:400:kworker.0 Request processed in 32us (1910us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760618.577143:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789760618.577155:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789760618.577162:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883020416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760618.577190:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883020416:12345-0@lo:400:kworker.0 Request processed in 29us (1726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760618.577195:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789760618.577213:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883019776 00000100:00100000:2.0:1789760618.577217:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883019776 00000100:00100000:2.0:1789760618.577240:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789760618.577260:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+19:3311:x1876699883019776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760618.577526:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+19:3311:x1876699883019776:12345-0@lo:400:kworker.0 Request processed in 279us (2003us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760618.577532:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789760618.577589:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277cd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699883019776:0@lo:400:kworker.0 00000100:00100000:2.0:1789760618.577603:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277cda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883019904:0@lo:400:kworker.0 00010000:00080000:2.0:1789760618.577614:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df25847fb80 x1876699883020416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760618.577623:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25847fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883020416:0@lo:400:kworker.0 00000100:00100000:0.0:1789760618.578356:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789760618.578363:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876699883020288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760618.578407:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876699883020288:12345-0@lo:400:kworker.0 Request processed in 43us (2843us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760618.578413:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1789760618.578434:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789760618.578439:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760618.578553:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25847f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1876699883020288:0@lo:400:kworker.0 00000100:00100000:1.0:1789760618.583051:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277cdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883020032:0@lo:400:kworker.0 00010000:00080000:1.0:1789760618.583084:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df25847c000 x1876699883020160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760618.583095:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25847c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883020160:0@lo:400:kworker.0 00010000:00010000:2.0:1789760618.703091:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760619.087611:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789760619.087634:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883020544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760619.087703:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760619.087764:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883020544 00000100:00100000:3.0:1789760619.087771:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883020544 00000100:00100000:3.0:1789760619.087833:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789760619.087843:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883020544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789760619.087874:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760619.087917:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883020544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760619.087924:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1789760619.087963:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df2747faa00 x1876699883020544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760635 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760619.087981:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883020544:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789760619.727046:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760620.658053:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760620.658106:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760620.658183:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863064832 00000100:00100000:3.0:1789760620.658206:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863064832 00000100:00100000:3.0:1789760620.658275:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 201 00000100:00100000:3.0:1789760620.658286:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:2350:x1876699863064832:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760620.658360:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:2350:x1876699863064832:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 75us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760620.658369:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 201 00000100:00100000:2.0:1789760620.658578:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863064960 00000100:00100000:2.0:1789760620.658582:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863064960 00000100:00100000:2.0:1789760620.658643:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:2.0:1789760620.658667:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25847d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863064960:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1789760620.658708:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25847d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863064960:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 51us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760620.658715:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00080000:1.0:1789760620.658916:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789760620.754544:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789760621.321491:0:9359:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.103 00010000:00010000:1.0:1789760621.775509:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760622.159368:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789760622.159390:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883020672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789760622.159457:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760622.159518:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883020672 00000100:00100000:3.0:1789760622.159525:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883020672 00000100:00100000:3.0:1789760622.159573:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789760622.159582:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883020672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760622.159612:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760622.160091:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883020672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 362us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760622.160101:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1789760622.160123:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789760622.160151:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df2747faa00 x1876699883020672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760638 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760622.160168:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883020672:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789760622.803273:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789760623.615382:0:9457:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.103 00000100:00100000:2.0:1789760623.695055:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d3f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883021056:0@lo:400:kworker.0 00000100:00100000:2.0:1789760623.695128:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760623.695185:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789760623.695192:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277cdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883021184:0@lo:400:kworker.0 00000100:00100000:2.0:1789760623.695253:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760623.695297:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883021056 00000100:00100000:2.0:1789760623.695305:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883021056 00000100:00100000:3.0:1789760623.695459:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d3f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883020800:0@lo:400:kworker.0 00000100:00100000:3.0:1789760623.695492:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760623.695515:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277cda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1876699883021312:0@lo:400:kworker.0 00000100:00100000:3.0:1789760623.695535:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760623.695562:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789760623.695567:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d3f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876699883020928:0@lo:400:kworker.0 00000100:00100000:3.0:1789760623.695588:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760623.695604:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277cd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883021440:0@lo:400:kworker.0 00000100:00100000:3.0:1789760623.695624:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760623.695681:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883021312 00000100:00100000:2.0:1789760623.695686:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883021312 00000100:00100000:2.0:1789760623.695704:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883020928 00000100:00100000:2.0:1789760623.695707:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883020928 00000100:00100000:2.0:1789760623.695721:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789760623.695730:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883021056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760623.695780:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883021056:12345-0@lo:400:kworker.0 Request processed in 51us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760623.695787:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789760623.695834:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789760623.695842:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876699883021312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760623.695875:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876699883021312:12345-0@lo:400:kworker.0 Request processed in 34us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760623.695881:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789760623.695901:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789760623.695906:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876699883020928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760623.695933:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876699883020928:12345-0@lo:400:kworker.0 Request processed in 27us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760623.695939:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789760623.695957:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883021184 00000100:00100000:2.0:1789760623.695961:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883021184 00000100:00100000:2.0:1789760623.695982:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883021440 00000100:00100000:2.0:1789760623.695984:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883021440 00000100:00100000:2.0:1789760623.696004:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789760623.696010:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883021184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760623.696041:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883021184:12345-0@lo:400:kworker.0 Request processed in 31us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760623.696047:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789760623.696057:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789760623.696062:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883021440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760623.696087:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883021440:12345-0@lo:400:kworker.0 Request processed in 25us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760623.696092:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1789760623.696106:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789760623.696111:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760623.696119:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883020800 00000100:00100000:2.0:1789760623.696123:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883020800 00000100:00100000:2.0:1789760623.696146:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1789760623.696152:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883020800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760623.696180:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883020800:12345-0@lo:400:kworker.0 Request processed in 29us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760623.696195:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1789760623.696272:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d3f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876699883020928:0@lo:400:kworker.0 00010000:00080000:2.0:1789760623.696285:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df277cd9f80 x1876699883021440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760623.696295:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277cd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883021440:0@lo:400:kworker.0 00000100:00100000:2.0:1789760623.696303:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d3f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883020800:0@lo:400:kworker.0 00000100:00100000:2.0:1789760623.696312:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277cda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1876699883021312:0@lo:400:kworker.0 00010000:00080000:2.0:1789760623.697506:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df277cdbb80 x1876699883021184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760623.697529:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277cdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883021184:0@lo:400:kworker.0 00000100:00100000:2.0:1789760623.697552:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d3f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883021056:0@lo:400:kworker.0 00010000:00010000:1.0:1789760623.823513:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760624.208403:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25847d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883021568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760624.208475:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760624.209464:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883021568 00000100:00100000:0.0:1789760624.209475:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883021568 00000100:00100000:0.0:1789760624.209535:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789760624.209544:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883021568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789760624.209602:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760624.209658:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883021568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760624.209665:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1789760624.211167:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df25847d180 x1876699883021568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760640 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760624.211190:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25847d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883021568:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789760624.850650:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789760625.753456:0:9506:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanityn ============----- Fri Sep 18 15:43:43 EDT 2026 00000100:00100000:0.0:1789760625.781631:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760625.781722:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760625.781844:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863065216 00000100:00100000:3.0:1789760625.781857:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863065216 00000100:00100000:3.0:1789760625.781949:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:3.0:1789760625.781962:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25847ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863065216:12345-192.168.203.12@tcp:400:kworker.0 00000100:00080000:1.0:1789760625.782048:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760625.782048:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25847ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863065216:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 89us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760625.782056:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:2.0:1789760625.783034:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863065088 00000100:00100000:2.0:1789760625.783043:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863065088 00000100:00100000:1.0:1789760625.792719:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 203 00000100:00100000:1.0:1789760625.792737:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247886850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:2351:x1876699863065088:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1789760625.792830:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247886850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:2351:x1876699863065088:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 98us (11483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760625.792838:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 203 00010000:00010000:2.0:1789760625.875388:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760626.896560:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760627.285115:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789760627.285136:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2513df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883021696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760627.285209:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760627.285512:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883021696 00000100:00100000:1.0:1789760627.285520:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883021696 00000100:00100000:1.0:1789760627.285595:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789760627.285608:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883021696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789760627.285651:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760627.285705:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883021696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760627.285712:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1789760627.285758:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df2513df480 x1876699883021696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760643 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760627.285788:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2513df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883021696:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789760627.285967:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789760627.919324:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760628.820967:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883021824:0@lo:400:kworker.0 00000100:00100000:1.0:1789760628.821032:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760628.821078:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1876699883022336:0@lo:400:kworker.0 00000100:00100000:1.0:1789760628.821103:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760628.821126:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789760628.821132:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876699883021952:0@lo:400:kworker.0 00000100:00100000:1.0:1789760628.821150:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760628.821165:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883022464:0@lo:400:kworker.0 00000100:00100000:3.0:1789760628.821428:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883022336 00000100:00100000:3.0:1789760628.821437:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883022336 00000100:00100000:1.0:1789760628.821522:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760628.821548:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883022080:0@lo:400:kworker.0 00000100:00100000:1.0:1789760628.821568:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760628.821585:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789760628.821591:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883022208:0@lo:400:kworker.0 00000100:00100000:1.0:1789760628.821611:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760628.821638:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883021824 00000100:00100000:1.0:1789760628.821642:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883021824 00000100:00100000:1.0:1789760628.821678:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789760628.821686:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247885c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883021824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760628.821735:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247885c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883021824:12345-0@lo:400:kworker.0 Request processed in 49us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760628.821742:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789760628.821772:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883021952 00000100:00100000:1.0:1789760628.821776:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883021952 00000100:00100000:1.0:1789760628.821823:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883022080 00000100:00100000:1.0:1789760628.821826:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883022080 00000100:00100000:3.0:1789760628.821884:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789760628.821892:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876699883021952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760628.821926:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876699883021952:12345-0@lo:400:kworker.0 Request processed in 36us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760628.821933:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789760628.821945:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789760628.821951:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876699883022336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760628.821975:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876699883022336:12345-0@lo:400:kworker.0 Request processed in 25us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760628.821981:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1789760628.826919:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760628.829400:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883022464 00000100:00100000:0.0:1789760628.829413:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883022464 00000100:00100000:0.0:1789760628.829473:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883022208 00000100:00100000:0.0:1789760628.829476:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883022208 00000100:00100000:0.0:1789760628.829499:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789760628.829509:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883022464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760628.829601:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883022464:12345-0@lo:400:kworker.0 Request processed in 94us (8079us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760628.829608:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789760628.829624:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789760628.829630:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883022208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760628.829662:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883022208:12345-0@lo:400:kworker.0 Request processed in 32us (8049us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760628.829667:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1789760628.829685:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789760628.829721:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27cc79180 x1876699883022208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760628.829736:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883022208:0@lo:400:kworker.0 00000100:00100000:1.0:1789760628.836361:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789760628.836375:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25855ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883022080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760628.836476:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25855ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883022080:12345-0@lo:400:kworker.0 Request processed in 104us (14906us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760628.836483:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789760628.836536:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876699883021952:0@lo:400:kworker.0 00010000:00080000:1.0:1789760628.836552:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27cc7a300 x1876699883022464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760628.836562:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883022464:0@lo:400:kworker.0 00000100:00100000:1.0:1789760628.836572:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883021824:0@lo:400:kworker.0 00000100:00100000:1.0:1789760628.836583:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1876699883022336:0@lo:400:kworker.0 00000100:00100000:0.0:1789760628.844236:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883022080:0@lo:400:kworker.0 00010000:00010000:2.0:1789760628.943121:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760629.327265:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25847f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883022592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760629.327344:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760629.327416:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883022592 00000100:00100000:0.0:1789760629.327425:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883022592 00000100:00100000:0.0:1789760629.327478:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789760629.327487:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c650700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883022592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789760629.327517:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760629.327568:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c650700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883022592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760629.327575:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1789760629.327749:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df25847f800 x1876699883022592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760645 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760629.327777:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25847f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883022592:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789760629.967147:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760630.903874:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760630.903923:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760630.904021:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863065472 00000100:00100000:1.0:1789760630.904030:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863065472 00000100:00100000:1.0:1789760630.904095:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:1.0:1789760630.904105:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25847c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863065472:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1789760630.904193:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25847c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863065472:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 90us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760630.904201:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:1.0:1789760630.904222:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863065344 00000100:00100000:1.0:1789760630.904225:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863065344 00000100:00100000:1.0:1789760630.904246:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 205 00000100:00100000:1.0:1789760630.904263:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:2350:x1876699863065344:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1789760630.904287:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:2350:x1876699863065344:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760630.904293:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 205 00000100:00080000:0.0:1789760630.907132:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789760630.992877:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760632.022472:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760632.405883:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789760632.405903:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2513de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883022720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760632.405962:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760632.406051:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883022720 00000100:00100000:0.0:1789760632.406067:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883022720 00000100:00100000:0.0:1789760632.406131:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789760632.406149:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883022720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789760632.406183:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760632.406239:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883022720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760632.406247:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1789760632.406325:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df2513de680 x1876699883022720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760648 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760632.406357:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2513de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883022720:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789760632.407307:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789760633.045768:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760633.935961:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883022848:0@lo:400:kworker.0 00000100:00100000:3.0:1789760633.936029:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760633.936111:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883022848 00000100:00100000:0.0:1789760633.936119:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883022848 00000100:00100000:0.0:1789760633.936184:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789760633.936193:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247884050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883022848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760633.939822:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247884050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883022848:12345-0@lo:400:kworker.0 Request processed in 3099us (3262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760633.939844:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789760633.939905:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883022976:0@lo:400:kworker.0 00000100:00100000:3.0:1789760633.940038:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883022848:0@lo:400:kworker.0 00000100:00100000:0.0:1789760633.940539:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760633.940930:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883023232:0@lo:400:kworker.0 00000100:00100000:3.0:1789760633.941051:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883022976 00000100:00100000:3.0:1789760633.941058:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883022976 00000100:00100000:3.0:1789760633.941104:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789760633.941112:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25847ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883022976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760633.941198:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760633.941227:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789760633.941233:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1876699883023104:0@lo:400:kworker.0 00000100:00100000:1.0:1789760633.941268:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760633.941293:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883023232 00000100:00100000:1.0:1789760633.941297:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883023232 00000100:00100000:1.0:1789760633.941340:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789760633.941346:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d328700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883023232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760633.941391:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d328700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883023232:12345-0@lo:400:kworker.0 Request processed in 46us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760633.941398:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789760633.941427:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883023104 00000100:00100000:1.0:1789760633.941431:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883023104 00000100:00100000:1.0:1789760633.941472:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789760633.941478:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d32b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876699883023104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760633.941507:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d32b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876699883023104:12345-0@lo:400:kworker.0 Request processed in 30us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760633.941514:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1789760633.941534:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760633.941575:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1876699883023104:0@lo:400:kworker.0 00010000:00080000:1.0:1789760633.941590:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27c653480 x1876699883023232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760633.941607:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883023232:0@lo:400:kworker.0 00000100:00100000:0.0:1789760633.944206:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d32aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883023488:0@lo:400:kworker.0 00000100:00100000:0.0:1789760633.944263:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760633.944547:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789760633.944555:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1876699883023360:0@lo:400:kworker.0 00000100:00100000:0.0:1789760633.944593:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760633.944723:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883023360 00000100:00100000:1.0:1789760633.944731:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883023360 00000100:00100000:1.0:1789760633.944795:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789760633.944824:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25847c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876699883023360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760633.944874:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25847c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876699883023360:12345-0@lo:400:kworker.0 Request processed in 71us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760633.944882:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789760633.944983:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25847ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883022976:12345-0@lo:400:kworker.0 Request processed in 3870us (4443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760633.944991:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789760633.946361:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1876699883023360:0@lo:400:kworker.0 00000100:00100000:0.0:1789760633.946378:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883022976:0@lo:400:kworker.0 00000100:00080000:0.0:1789760633.946412:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760633.951962:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883023488 00000100:00100000:2.0:1789760633.951977:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883023488 00000100:00100000:2.0:1789760633.952039:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789760633.952049:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25847ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883023488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760633.952143:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25847ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883023488:12345-0@lo:400:kworker.0 Request processed in 85us (7868us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760633.952150:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1789760633.952246:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26d32aa00 x1876699883023488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760633.952262:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d32aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883023488:0@lo:400:kworker.0 00000100:00080000:0.0:1789760633.952288:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789760634.063745:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760634.454637:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25847f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883023616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760634.454737:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760634.454829:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883023616 00000100:00100000:0.0:1789760634.454836:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883023616 00000100:00100000:0.0:1789760634.454880:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789760634.454889:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25847df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883023616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789760634.454923:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760634.454962:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25847df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883023616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760634.454980:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1789760634.455022:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df25847f480 x1876699883023616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760650 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760634.455038:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25847f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883023616:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789760635.103500:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760636.023286:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760636.023327:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760636.023438:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863065600 00000100:00100000:1.0:1789760636.023449:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863065600 00000100:00100000:1.0:1789760636.023524:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 207 00000100:00100000:1.0:1789760636.023536:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247886450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:2348:x1876699863065600:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1789760636.023759:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247886450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:2348:x1876699863065600:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 223us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760636.023768:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 207 00000100:00100000:1.0:1789760636.025269:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863065728 00000100:00100000:1.0:1789760636.025280:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863065728 00000100:00100000:1.0:1789760636.026269:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:1.0:1789760636.026287:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25847f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863065728:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1789760636.026376:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25847f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863065728:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 96us (3048us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760636.026383:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00080000:2.0:1789760636.026515:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789760636.112133:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760637.148735:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760637.522983:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2513ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883023744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760637.523058:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760637.526427:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883023744 00000100:00100000:2.0:1789760637.526440:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883023744 00000100:00100000:0.0:1789760637.526578:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789760637.526589:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d329f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883023744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789760637.526625:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760637.526713:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d329f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883023744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (3653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760637.526721:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1789760637.526868:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df2513ded80 x1876699883023744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760653 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760637.526889:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2513ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883023744:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789760637.527233:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789760638.163689:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760639.055347:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25847ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883024128:0@lo:400:kworker.0 00000100:00100000:0.0:1789760639.055413:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760639.055475:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789760639.055481:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25847f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883024256:0@lo:400:kworker.0 00000100:00100000:0.0:1789760639.055515:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760639.055553:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883024128 00000100:00100000:0.0:1789760639.055560:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883024128 00000100:00100000:0.0:1789760639.055610:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789760639.055619:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25847f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883024128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760639.055677:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25847f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883024128:12345-0@lo:400:kworker.0 Request processed in 60us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760639.055684:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789760639.055708:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883024256 00000100:00100000:0.0:1789760639.055718:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883024256 00000100:00100000:0.0:1789760639.055746:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789760639.055752:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25847fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883024256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760639.055795:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25847fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883024256:12345-0@lo:400:kworker.0 Request processed in 44us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760639.055829:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1789760639.055847:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789760639.055851:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789760639.055880:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df25847f800 x1876699883024256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760639.055894:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25847f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883024256:0@lo:400:kworker.0 00000100:00100000:0.0:1789760639.055905:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25847ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883024128:0@lo:400:kworker.0 00000100:00100000:1.0:1789760639.056189:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25847d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883024000:0@lo:400:kworker.0 00000100:00100000:1.0:1789760639.056220:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760639.056246:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25847c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883024512:0@lo:400:kworker.0 00000100:00100000:1.0:1789760639.056263:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760639.056286:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789760639.056292:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25847e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699883023872:0@lo:400:kworker.0 00000100:00100000:1.0:1789760639.056316:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760639.056332:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25847d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1876699883024384:0@lo:400:kworker.0 00000100:00100000:1.0:1789760639.056350:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760639.056373:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883024512 00000100:00100000:1.0:1789760639.056376:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883024512 00000100:00100000:1.0:1789760639.056404:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789760639.056411:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883024512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760639.056448:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883024512:12345-0@lo:400:kworker.0 Request processed in 37us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760639.056454:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789760639.056472:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883024000 00000100:00100000:1.0:1789760639.056475:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883024000 00000100:00100000:0.0:1789760639.056558:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883024384 00000100:00100000:0.0:1789760639.056563:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883024384 00000100:00100000:0.0:1789760639.056590:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789760639.056596:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d32ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876699883024384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760639.056627:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d32ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876699883024384:12345-0@lo:400:kworker.0 Request processed in 31us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760639.056632:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789760639.056663:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883023872 00000100:00100000:0.0:1789760639.056666:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883023872 00000100:00100000:0.0:1789760639.056689:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789760639.056695:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+19:3311:x1876699883023872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760639.056720:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+19:3311:x1876699883023872:12345-0@lo:400:kworker.0 Request processed in 26us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760639.056726:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:0.0:1789760639.056773:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789760639.056777:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789760639.056826:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25847e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699883023872:0@lo:400:kworker.0 00000100:00100000:0.0:1789760639.056836:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25847d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1876699883024384:0@lo:400:kworker.0 00010000:00080000:0.0:1789760639.056845:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df25847c000 x1876699883024512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760639.056853:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25847c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883024512:0@lo:400:kworker.0 00000100:00100000:1.0:1789760639.057601:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789760639.057610:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d32a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883024000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760639.058609:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d32a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883024000:12345-0@lo:400:kworker.0 Request processed in 996us (2383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760639.058625:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789760639.059036:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25847d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883024000:0@lo:400:kworker.0 00010000:00010000:1.0:1789760639.190728:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760639.567142:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789760639.567171:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25847d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883024640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760639.567235:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760639.567322:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883024640 00000100:00100000:0.0:1789760639.567329:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883024640 00000100:00100000:0.0:1789760639.567376:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789760639.567385:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25847c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883024640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789760639.567418:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760639.567473:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25847c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883024640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760639.567480:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1789760639.567532:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df25847d880 x1876699883024640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760655 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760639.567550:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25847d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883024640:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789760640.217261:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760641.141383:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760641.141425:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760641.141469:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863065984 00000100:00100000:0.0:1789760641.141478:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863065984 00000100:00100000:0.0:1789760641.141535:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:0.0:1789760641.141544:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25847d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863065984:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1789760641.141618:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25847d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863065984:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 75us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760641.141625:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00080000:0.0:1789760641.141647:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760641.141949:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863065856 00000100:00100000:2.0:1789760641.141955:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863065856 00000100:00100000:2.0:1789760641.141989:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 209 00000100:00100000:2.0:1789760641.141997:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247886c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:2351:x1876699863065856:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1789760641.142036:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247886c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:2351:x1876699863065856:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 41us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760641.142043:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 209 00010000:00010000:3.0:1789760641.231219:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760642.256314:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760642.638957:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883024768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789760642.639019:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760642.639080:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883024768 00000100:00100000:1.0:1789760642.639089:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883024768 00000100:00100000:1.0:1789760642.639150:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789760642.639159:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883024768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789760642.639186:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760642.639224:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883024768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760642.639230:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1789760642.639230:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789760642.639263:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27d0ed880 x1876699883024768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760658 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760642.639276:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883024768:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1789760643.188640:0:10234:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 40a 00010000:00010000:3.0:1789760643.281166:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760644.175209:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d32b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883025024:0@lo:400:kworker.0 00000100:00100000:1.0:1789760644.175239:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d32a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883025280:0@lo:400:kworker.0 00000100:00100000:3.0:1789760644.175334:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883024896:0@lo:400:kworker.0 00000100:00100000:2.0:1789760644.175382:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d32bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883025152:0@lo:400:kworker.0 00000100:00100000:1.0:1789760644.175454:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760644.176645:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760644.176686:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883025536:0@lo:400:kworker.0 00000100:00100000:1.0:1789760644.176705:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883025280 00000100:00100000:1.0:1789760644.176716:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883025280 00000100:00100000:0.0:1789760644.176723:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760644.176760:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883025536 00000100:00100000:0.0:1789760644.176765:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883025536 00000100:00100000:1.0:1789760644.176785:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789760644.176876:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789760644.176884:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25847e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883025536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760644.177004:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25847e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883025536:12345-0@lo:400:kworker.0 Request processed in 61us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760644.177021:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1789760644.177173:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26d329500 x1876699883025536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760644.177188:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883025536:0@lo:400:kworker.0 00000100:00100000:3.0:1789760644.177468:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760644.177504:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1876699883025408:0@lo:400:kworker.0 00000100:00100000:3.0:1789760644.177533:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760644.177565:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883024896 00000100:00100000:3.0:1789760644.177585:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883024896 00000100:00100000:3.0:1789760644.177618:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789760644.177625:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247887050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883024896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760644.177660:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247887050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883024896:12345-0@lo:400:kworker.0 Request processed in 36us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760644.177666:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789760644.177697:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883025024 00000100:00100000:3.0:1789760644.177701:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883025024 00000100:00100000:3.0:1789760644.177724:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883025408 00000100:00100000:3.0:1789760644.177726:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883025408 00000100:00100000:3.0:1789760644.177746:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789760644.177752:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25847d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883025024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760644.177798:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25847d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883025024:12345-0@lo:400:kworker.0 Request processed in 46us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760644.177821:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789760644.177834:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789760644.177839:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876699883025408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760644.177863:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876699883025408:12345-0@lo:400:kworker.0 Request processed in 24us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760644.177868:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789760644.177899:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883024896:0@lo:400:kworker.0 00000100:00100000:3.0:1789760644.177909:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1876699883025408:0@lo:400:kworker.0 00000100:00100000:3.0:1789760644.177932:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d32b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883025024:0@lo:400:kworker.0 00000100:00100000:2.0:1789760644.178562:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760644.178628:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d329180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883025280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760644.178639:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883025152 00000100:00100000:3.0:1789760644.178643:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883025152 00000100:00100000:1.0:1789760644.178684:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d329180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883025280:12345-0@lo:400:kworker.0 Request processed in 1891us (3231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760644.178691:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789760644.178734:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789760644.178749:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883025152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760644.178796:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883025152:12345-0@lo:400:kworker.0 Request processed in 48us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760644.178818:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1789760644.178865:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26d32a300 x1876699883025280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760644.178877:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d32a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883025280:0@lo:400:kworker.0 00000100:00100000:2.0:1789760644.179890:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d32bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883025152:0@lo:400:kworker.0 00000100:00080000:1.0:1789760644.180260:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789760644.180268:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789760644.180420:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789760644.309431:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789760644.485583:0:10282:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: skipping tests SLOW=no: 33a 00000100:00100000:1.0:1789760644.688939:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d328a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883025664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760644.689067:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760644.690033:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883025664 00000100:00100000:1.0:1789760644.690046:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883025664 00000100:00100000:1.0:1789760644.690192:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789760644.690207:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d32b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883025664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789760644.690254:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760644.690334:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d32b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883025664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (1266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760644.690341:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1789760644.690391:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26d328a80 x1876699883025664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760660 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760644.690414:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d328a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883025664:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789760645.335215:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760646.258634:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760646.258686:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760646.258767:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863066240 00000100:00100000:3.0:1789760646.258779:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863066240 00000100:00100000:3.0:1789760646.258878:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:3.0:1789760646.258890:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25847ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863066240:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760646.258963:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25847ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863066240:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 76us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760646.258971:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00080000:0.0:1789760646.259297:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760646.259537:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863066112 00000100:00100000:2.0:1789760646.259543:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863066112 00000100:00100000:2.0:1789760646.259573:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 211 00000100:00100000:2.0:1789760646.259580:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247885450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:2350:x1876699863066112:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1789760646.259625:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247885450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:2350:x1876699863066112:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 45us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760646.259632:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 211 00000001:02000400:1.0:1789760646.271204:0:10331:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanityn: start setup 15:44:04 (1789760644) === 00010000:00010000:3.0:1789760646.356263:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760646.685270:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760646.685337:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863066368 00000100:00100000:3.0:1789760646.685348:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863066368 00000100:00100000:3.0:1789760646.685462:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 212 00000100:00100000:3.0:1789760646.685482:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247887850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+10:8477:x1876699863066368:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789760646.685499:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760646.685517:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df2778e9600/0x3e099f5ef04adc2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2cf73 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760646.685547:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df2778e9600/0x3e099f5ef04adc2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cf73 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760646.685557:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df2778e9600/0x3e099f5ef04adc2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cf73 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760646.685567:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2778e9600, rc 0) 00000100:00100000:3.0:1789760646.685644:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247887850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+11:8477:x1876699863066368:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 165us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760646.685651:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 212 00000100:00100000:0.0:1789760646.694219:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760646.695356:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863066496 00000100:00100000:3.0:1789760646.695369:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863066496 00000100:00100000:2.0:1789760646.695651:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 213 00000100:00100000:2.0:1789760646.695666:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247884c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+11:8477:x1876699863066496:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789760646.696179:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247884c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+11:8477:x1876699863066496:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 515us (1970us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760646.696188:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 213 00000100:00100000:0.0:1789760646.702248:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760646.702300:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863066624 00000100:00100000:3.0:1789760646.702311:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863066624 00000100:00100000:3.0:1789760646.702363:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 214 00000100:00100000:3.0:1789760646.702373:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247885050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+11:8477:x1876699863066624:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789760646.702614:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247885050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+11:8477:x1876699863066624:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 242us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760646.702623:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 214 00000100:00100000:0.0:1789760646.710920:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760646.710990:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863066752 00000100:00100000:2.0:1789760646.711000:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863066752 00000100:00100000:2.0:1789760646.711079:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 215 00000100:00100000:2.0:1789760646.711091:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+11:8481:x1876699863066752:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789760646.711579:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+11:8481:x1876699863066752:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 488us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760646.711588:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 215 00000100:00100000:0.0:1789760646.730962:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760646.736491:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863066880 00000100:00100000:3.0:1789760646.736507:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863066880 00000100:00100000:3.0:1789760646.736572:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 216 00000100:00100000:3.0:1789760646.736583:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247885850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+11:8481:x1876699863066880:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789760646.737101:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247885850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+11:8481:x1876699863066880:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 519us (6148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760646.737110:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 216 00000100:00100000:3.0:1789760646.757787:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760646.760738:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863067008 00000100:00100000:2.0:1789760646.760754:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863067008 00000100:00100000:2.0:1789760646.760890:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 217 00000100:00100000:2.0:1789760646.760901:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+11:8477:x1876699863067008:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789760646.760924:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760646.760946:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241538c00/0x3e099f5ef04adc35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2cf9d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.761120:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241538c00/0x3e099f5ef04adc35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cf9d expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.761136:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241538c00/0x3e099f5ef04adc35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cf9d expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.761146:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241538c00, rc 0) 00000100:00100000:2.0:1789760646.761268:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+12:8477:x1876699863067008:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 367us (3489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760646.761276:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 217 00000100:00100000:0.0:1789760646.764440:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760646.764578:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863067136 00000100:00100000:3.0:1789760646.764589:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863067136 00000100:00100000:3.0:1789760646.764675:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 218 00000100:00100000:3.0:1789760646.764685:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+12:8477:x1876699863067136:12345-192.168.203.12@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789760646.764709:0:5839:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789760646.764735:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789760646.764745:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789760646.764748:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789760646.764751:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1789760646.766712:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+12:8477:x1876699863067136:12345-192.168.203.12@tcp:256:mount.lustre.0 Request processed in 2018us (2270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760646.766725:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 218 00000100:00100000:1.0:1789760646.770631:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760646.770727:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863067264 00000100:00100000:2.0:1789760646.770751:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863067264 00000100:00100000:2.0:1789760646.770871:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 219 00000100:00100000:2.0:1789760646.770882:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+12:8477:x1876699863067264:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789760646.770899:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760646.770917:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241538000/0x3e099f5ef04adc3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2cfa4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.770946:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241538000/0x3e099f5ef04adc3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cfa4 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.770974:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241538000/0x3e099f5ef04adc3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cfa4 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760646.770984:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241538000, rc 0) 00000100:00100000:2.0:1789760646.771053:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:8477:x1876699863067264:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 173us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760646.771059:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 219 00000100:00100000:1.0:1789760646.773217:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760646.774263:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863067392 00000100:00100000:0.0:1789760646.774276:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863067392 00000100:00100000:0.0:1789760646.774327:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 220 00000100:00100000:0.0:1789760646.774337:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:8477:x1876699863067392:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789760646.774633:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:8477:x1876699863067392:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 297us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760646.774640:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 220 00000100:00100000:1.0:1789760646.776445:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760646.776526:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863067520 00000100:00100000:2.0:1789760646.776534:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863067520 00000100:00100000:2.0:1789760646.776578:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 221 00000100:00100000:2.0:1789760646.776587:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:8477:x1876699863067520:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789760646.776820:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:8477:x1876699863067520:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 213us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760646.776828:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 221 00000100:00100000:1.0:1789760646.780172:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760646.780330:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863067648 00000100:00100000:2.0:1789760646.780340:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863067648 00000100:00100000:2.0:1789760646.780439:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 222 00000100:00100000:2.0:1789760646.780452:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:8484:x1876699863067648:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789760646.780725:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:8484:x1876699863067648:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 274us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760646.780733:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 222 00000100:00100000:1.0:1789760646.785158:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760646.789184:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863067776 00000100:00100000:0.0:1789760646.789198:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863067776 00000100:00100000:0.0:1789760646.789257:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 223 00000100:00100000:0.0:1789760646.789268:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:8484:x1876699863067776:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789760646.789531:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:8484:x1876699863067776:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 264us (4386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760646.789540:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 223 00000100:00100000:1.0:1789760646.794045:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760646.794394:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863067904 00000100:00100000:2.0:1789760646.794405:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863067904 00000100:00100000:2.0:1789760646.794462:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:2.0:1789760646.794556:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2347:x1876699863067904:12345-192.168.203.12@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789760646.794583:0:7279:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 7c264b2a-20ff-4f4b-947d-777de3ce523e@192.168.203.12@tcp t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:2.0:1789760646.794618:0:7279:0:(genops.c:1385:class_connect()) connect: client 7c264b2a-20ff-4f4b-947d-777de3ce523e, cookie 0x3e099f5ef04adc43 00000004:00100000:2.0:1789760646.794645:0:7279:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789760646.795042:0:7279:0:(import.c:65:import_set_state_nolock()) ffff8df26d415800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789760646.795146:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c264b2a-20ff-4f4b-947d-777de3ce523e+6:2347:x1876699863067904:12345-192.168.203.12@tcp:38:mount.lustre.0 Request processed in 591us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760646.795153:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:1.0:1789760646.798644:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760646.798725:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760646.808788:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863068032 00000100:00100000:3.0:1789760646.808880:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863068032 00000100:00100000:2.0:1789760646.809414:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863068160 00000100:00100000:2.0:1789760646.809420:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863068160 00000100:00100000:2.0:1789760646.809448:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:2.0:1789760646.809458:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c264b2a-20ff-4f4b-947d-777de3ce523e+7:0:x1876699863068032:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789760646.809509:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789760646.809599:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c264b2a-20ff-4f4b-947d-777de3ce523e+7:0:x1876699863068032:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 141us (10966us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760646.809606:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:2.0:1789760646.809626:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:2.0:1789760646.809632:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c264b2a-20ff-4f4b-947d-777de3ce523e+6:8477:x1876699863068160:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789760646.809660:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789760646.809683:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c264b2a-20ff-4f4b-947d-777de3ce523e+6:8477:x1876699863068160:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 51us (10958us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760646.809689:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:0.0:1789760646.811825:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760646.811898:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863068288 00000100:00100000:2.0:1789760646.811907:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863068288 00000100:00100000:2.0:1789760646.811955:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:2.0:1789760646.811965:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25847f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c264b2a-20ff-4f4b-947d-777de3ce523e+6:8477:x1876699863068288:12345-192.168.203.12@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789760646.812059:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25847f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c264b2a-20ff-4f4b-947d-777de3ce523e+6:8477:x1876699863068288:12345-192.168.203.12@tcp:40:mount.lustre.0 Request processed in 96us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760646.812067:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:2.0:1789760646.815540:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760646.815631:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760646.815666:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00080000:1.0:1789760646.815757:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760646.815850:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863068416 00000100:00100000:1.0:1789760646.815860:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863068416 00000100:00100000:1.0:1789760646.815904:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863068544 00000100:00100000:1.0:1789760646.815907:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863068544 00000100:00100000:1.0:1789760646.815945:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:1.0:1789760646.815953:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1876699863068416:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789760646.816005:0:6695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 7c264b2a-20ff-4f4b-947d-777de3ce523e@192.168.203.12@tcp t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:1.0:1789760646.816043:0:6695:0:(genops.c:1385:class_connect()) connect: client 7c264b2a-20ff-4f4b-947d-777de3ce523e, cookie 0x3e099f5ef04adc4a 00002000:00100000:1.0:1789760646.816056:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7c264b2a-20ff-4f4b-947d-777de3ce523e/ffff8df26cfe6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789760646.816083:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1789760646.816629:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:2.0:1789760646.816636:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2347:x1876699863068544:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789760646.816656:0:6693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 7c264b2a-20ff-4f4b-947d-777de3ce523e@192.168.203.12@tcp t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:2.0:1789760646.816678:0:6693:0:(genops.c:1385:class_connect()) connect: client 7c264b2a-20ff-4f4b-947d-777de3ce523e, cookie 0x3e099f5ef04adc51 00002000:00100000:2.0:1789760646.816683:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7c264b2a-20ff-4f4b-947d-777de3ce523e/ffff8df26d412800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789760646.816697:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789760646.816878:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789760646.816916:0:6693:0:(import.c:65:import_set_state_nolock()) ffff8df26d417800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789760646.817005:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c264b2a-20ff-4f4b-947d-777de3ce523e+6:2347:x1876699863068544:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 367us (1338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760646.817026:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00002000:00080000:1.0:1789760646.818138:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789760646.818163:0:6695:0:(import.c:65:import_set_state_nolock()) ffff8df26cfe7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789760646.818218:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c264b2a-20ff-4f4b-947d-777de3ce523e+6:2347:x1876699863068416:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 2264us (2586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760646.818226:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:0.0:1789760646.819927:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863068672 00000100:00100000:0.0:1789760646.819938:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863068672 00000100:00100000:0.0:1789760646.820144:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:0.0:1789760646.820155:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c264b2a-20ff-4f4b-947d-777de3ce523e+6:8477:x1876699863068672:12345-192.168.203.12@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789760646.820263:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789760646.820344:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c264b2a-20ff-4f4b-947d-777de3ce523e+6:8477:x1876699863068672:12345-192.168.203.12@tcp:33:mount.lustre.0 Request processed in 190us (4813us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760646.820351:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00010000:00010000:3.0:1789760647.377554:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760647.759164:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789760647.759188:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883025792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789760647.759262:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760647.759451:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883025792 00000100:00100000:3.0:1789760647.759460:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883025792 00000100:00100000:3.0:1789760647.759519:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789760647.759528:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883025792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760647.759548:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760647.759591:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883025792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760647.759598:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1789760647.759653:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789760647.759680:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27d0eed80 x1876699883025792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760663 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760647.759698:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883025792:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1789760647.799851:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7c264b2a-20ff-4f4b-947d-777de3ce523e 00010000:00010000:2.0:1789760648.399946:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760649.296138:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d32a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883026048:0@lo:400:kworker.0 00000100:00100000:2.0:1789760649.296251:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760649.296328:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883026560:0@lo:400:kworker.0 00000100:00100000:2.0:1789760649.296358:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760649.296397:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789760649.296404:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d32bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699883025920:0@lo:400:kworker.0 00000100:00100000:2.0:1789760649.296434:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760649.296473:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1876699883026432:0@lo:400:kworker.0 00000100:00100000:2.0:1789760649.296496:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760649.296539:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883026304:0@lo:400:kworker.0 00000100:00100000:2.0:1789760649.296571:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760649.296591:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789760649.296597:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d32b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1876699883026176:0@lo:400:kworker.0 00000100:00100000:2.0:1789760649.296622:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760649.296654:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883026560 00000100:00100000:2.0:1789760649.296664:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883026560 00000100:00100000:2.0:1789760649.296724:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883026304 00000100:00100000:2.0:1789760649.296728:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883026304 00000100:00100000:2.0:1789760649.296755:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789760649.296766:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883026560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760649.297066:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883026560:12345-0@lo:400:kworker.0 Request processed in 293us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760649.297099:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789760649.297134:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789760649.297144:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883026304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760649.297199:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883026304:12345-0@lo:400:kworker.0 Request processed in 57us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760649.297206:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789760649.297382:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883026048 00000100:00100000:1.0:1789760649.297389:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883026048 00000100:00100000:2.0:1789760649.297399:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883025920 00000100:00100000:2.0:1789760649.297409:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883025920 00000100:00100000:1.0:1789760649.297438:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883026432 00000100:00100000:1.0:1789760649.297454:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883026432 00000100:00100000:2.0:1789760649.297460:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789760649.297473:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:3311:x1876699883025920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760649.297483:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883026176 00000100:00100000:1.0:1789760649.297488:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883026176 00000100:00100000:1.0:1789760649.297509:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789760649.297516:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883026048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760649.297663:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883026048:12345-0@lo:400:kworker.0 Request processed in 147us (1411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760649.297670:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789760649.297686:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789760649.297692:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876699883026432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760649.297721:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876699883026432:12345-0@lo:400:kworker.0 Request processed in 30us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760649.297740:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789760649.297753:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789760649.297760:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876699883026176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760649.297789:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876699883026176:12345-0@lo:400:kworker.0 Request processed in 30us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760649.297794:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789760649.298362:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:3311:x1876699883025920:12345-0@lo:400:kworker.0 Request processed in 890us (1923us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760649.298372:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00080000:2.0:1789760649.298428:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789760649.298435:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789760649.298437:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789760649.298484:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d32b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1876699883026176:0@lo:400:kworker.0 00010000:00080000:2.0:1789760649.299153:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26d329c00 x1876699883026304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760649.299232:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883026304:0@lo:400:kworker.0 00000100:00100000:2.0:1789760649.299284:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d32bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699883025920:0@lo:400:kworker.0 00000100:00100000:2.0:1789760649.299297:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1876699883026432:0@lo:400:kworker.0 00000100:00100000:2.0:1789760649.299309:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d32a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883026048:0@lo:400:kworker.0 00010000:00080000:2.0:1789760649.299343:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26d329500 x1876699883026560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760649.299353:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883026560:0@lo:400:kworker.0 00010000:00010000:3.0:1789760649.423721:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760649.807159:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789760649.807180:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883026688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760649.807242:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760649.808760:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883026688 00000100:00100000:3.0:1789760649.808772:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883026688 00000100:00100000:3.0:1789760649.808849:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789760649.808860:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883026688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789760649.808895:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760649.808982:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883026688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (1738us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760649.808988:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1789760649.809038:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27cc7bb80 x1876699883026688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760665 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760649.809056:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883026688:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1789760649.910662:0:7658:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7c264b2a-20ff-4f4b-947d-777de3ce523e 00000001:00100000:2.0:1789760650.390395:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7c264b2a-20ff-4f4b-947d-777de3ce523e 00010000:00010000:3.0:1789760650.448480:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760651.474949:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760651.891768:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760651.891897:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760651.891924:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760651.891940:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760651.893872:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863069184 00000100:00100000:3.0:1789760651.893886:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863069184 00000100:00100000:3.0:1789760651.893963:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:3.0:1789760651.893973:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2351:x1876699863069184:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760651.894078:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2351:x1876699863069184:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 105us (2180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760651.894086:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:1.0:1789760651.895383:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863068928 00000100:00100000:1.0:1789760651.895392:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863068928 00000100:00100000:1.0:1789760651.895440:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863069056 00000100:00100000:1.0:1789760651.895445:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863069056 00000100:00100000:2.0:1789760651.895445:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760651.895490:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:1.0:1789760651.895500:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863068928:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1789760651.895505:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:2.0:1789760651.895520:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2351:x1876699863069056:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1789760651.895555:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863068928:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 56us (3797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760651.895567:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:2.0:1789760651.895570:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2351:x1876699863069056:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 50us (3622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760651.895581:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:1.0:1789760651.895596:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863068800 00000100:00100000:1.0:1789760651.895601:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863068800 00000100:00100000:1.0:1789760651.895628:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 225 00000100:00100000:1.0:1789760651.895633:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2351:x1876699863068800:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1789760651.895670:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2351:x1876699863068800:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 36us (3745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760651.895676:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 225 00000100:00100000:2.0:1789760651.896387:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863069312 00000100:00100000:2.0:1789760651.896531:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863069312 00000100:00100000:2.0:1789760651.896571:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:2.0:1789760651.896580:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2351:x1876699863069312:12345-192.168.203.12@tcp:400:kworker.0 00000100:00080000:0.0:1789760651.896585:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789760651.896591:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789760651.896594:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760651.896630:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2351:x1876699863069312:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 52us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760651.896638:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00000001:02000400:2.0:1789760651.918664:0:10528:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1789760652.497597:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760652.879603:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789760652.879641:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883026816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789760652.879704:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760652.880075:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883026816 00000100:00100000:3.0:1789760652.880084:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883026816 00000100:00100000:3.0:1789760652.880140:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789760652.880151:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883026816:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789760652.880244:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789760652.880314:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760652.880367:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883026816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 218us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760652.880374:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1789760652.881100:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27d0ee300 x1876699883026816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760668 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760652.881135:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883026816:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789760653.520077:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760654.416375:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883027200:0@lo:400:kworker.0 00000100:00100000:3.0:1789760654.416384:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883027072:0@lo:400:kworker.0 00000100:00100000:2.0:1789760654.416388:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883026944:0@lo:400:kworker.0 00000100:00100000:1.0:1789760654.416450:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760654.416452:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760654.416488:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883027328:0@lo:400:kworker.0 00000100:00100000:2.0:1789760654.416504:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1876699883027456:0@lo:400:kworker.0 00000100:00100000:1.0:1789760654.416522:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883027200 00000100:00100000:3.0:1789760654.416525:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760654.416536:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883027200 00000100:00100000:3.0:1789760654.416564:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883027328 00000100:00100000:3.0:1789760654.416569:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883027328 00000100:00100000:1.0:1789760654.416596:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789760654.416604:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760654.416608:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789760654.416609:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d32aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883027200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760654.416620:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883027328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760654.416705:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d32aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883027200:12345-0@lo:400:kworker.0 Request processed in 101us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760654.416706:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883026944 00000100:00100000:2.0:1789760654.416710:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883026944 00000100:00100000:1.0:1789760654.416713:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789760654.416726:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883027456 00000100:00100000:1.0:1789760654.416729:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883027456 00000100:00100000:1.0:1789760654.416747:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789760654.416747:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789760654.416753:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876699883027456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760654.416753:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883026944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760654.416785:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876699883027456:12345-0@lo:400:kworker.0 Request processed in 32us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760654.416788:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883026944:12345-0@lo:400:kworker.0 Request processed in 36us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760654.416791:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789760654.416793:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789760654.416887:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883027328:12345-0@lo:400:kworker.0 Request processed in 270us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760654.416894:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789760654.416917:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760654.416934:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883027584:0@lo:400:kworker.0 00000100:00100000:3.0:1789760654.416958:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789760654.416959:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27d0ed500 x1876699883027328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760654.416975:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883027328:0@lo:400:kworker.0 00000100:00100000:3.0:1789760654.417007:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883027584 00000100:00100000:3.0:1789760654.417012:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883027584 00000100:00100000:3.0:1789760654.417048:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1789760654.417055:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789760654.417056:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883027584:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789760654.417062:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760654.417092:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883027584:12345-0@lo:400:kworker.0 Request processed in 37us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760654.417098:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1789760654.417122:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27d0ed880 x1876699883027584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760654.417132:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883027584:0@lo:400:kworker.0 00000100:00080000:1.0:1789760654.417152:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760654.417166:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883027072 00000100:00100000:1.0:1789760654.417171:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883027072 00000100:00100000:1.0:1789760654.417189:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789760654.417195:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883027072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760654.417235:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883027072:12345-0@lo:400:kworker.0 Request processed in 39us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760654.417241:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789760654.417259:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883027072:0@lo:400:kworker.0 00000100:00100000:1.0:1789760654.417346:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883027200:0@lo:400:kworker.0 00000100:00100000:1.0:1789760654.417369:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883026944:0@lo:400:kworker.0 00000100:00100000:1.0:1789760654.417378:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1876699883027456:0@lo:400:kworker.0 00010000:00010000:1.0:1789760654.543008:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760654.927990:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789760654.928011:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883027712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760654.928074:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760654.928249:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883027712 00000100:00100000:1.0:1789760654.928257:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883027712 00000100:00100000:1.0:1789760654.928310:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789760654.928319:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883027712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789760654.928353:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760654.928400:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883027712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760654.928407:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1789760654.928456:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26d329500 x1876699883027712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760670 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760654.928475:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883027712:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789760655.567760:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760656.591076:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760657.015014:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760657.015064:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760657.015095:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760657.015117:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760657.015157:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760657.015187:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863069440 00000100:00100000:3.0:1789760657.015195:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863069440 00000100:00100000:3.0:1789760657.015240:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 227 00000100:00100000:3.0:1789760657.015249:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2350:x1876699863069440:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760657.015309:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2350:x1876699863069440:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 61us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760657.015318:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 227 00000100:00100000:3.0:1789760657.015347:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863069568 00000100:00100000:3.0:1789760657.015351:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863069568 00000100:00100000:3.0:1789760657.015383:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863069696 00000100:00100000:3.0:1789760657.015386:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863069696 00000100:00100000:3.0:1789760657.015406:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:3.0:1789760657.015412:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863069568:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760657.015441:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863069568:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760657.015447:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:3.0:1789760657.015459:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:3.0:1789760657.015465:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2350:x1876699863069696:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760657.015486:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2350:x1876699863069696:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 21us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760657.015493:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:3.0:1789760657.015507:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863069824 00000100:00100000:3.0:1789760657.015511:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863069824 00000100:00100000:3.0:1789760657.015532:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863069952 00000100:00100000:3.0:1789760657.015535:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863069952 00000100:00100000:3.0:1789760657.015554:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:3.0:1789760657.015567:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2350:x1876699863069824:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760657.015592:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2350:x1876699863069824:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760657.015598:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:3.0:1789760657.015609:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:3.0:1789760657.015615:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2350:x1876699863069952:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760657.015634:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2350:x1876699863069952:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 20us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760657.015640:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00080000:3.0:1789760657.015763:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789760657.015767:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789760657.015770:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789760657.614967:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760658.001897:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789760658.001922:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cd8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883027840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789760658.001995:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760658.002056:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883027840 00000100:00100000:3.0:1789760658.002063:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883027840 00000100:00100000:3.0:1789760658.002109:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789760658.002117:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883027840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760658.002150:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760658.002202:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883027840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760658.002209:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1789760658.002228:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789760658.002256:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27cd8c000 x1876699883027840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760674 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760658.002368:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cd8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883027840:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789760658.639185:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760659.537372:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883028224:0@lo:400:kworker.0 00000100:00100000:0.0:1789760659.537460:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760659.537520:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789760659.537527:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883028352:0@lo:400:kworker.0 00000100:00100000:0.0:1789760659.537554:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760659.537788:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883028224 00000100:00100000:0.0:1789760659.537796:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883028224 00000100:00100000:0.0:1789760659.537891:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789760659.537901:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883028224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760659.537973:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883028224:12345-0@lo:400:kworker.0 Request processed in 73us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760659.537980:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789760659.538018:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883028352 00000100:00100000:0.0:1789760659.538021:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883028352 00000100:00100000:0.0:1789760659.538063:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789760659.538070:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883028352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760659.538098:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883028352:12345-0@lo:400:kworker.0 Request processed in 29us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760659.538104:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1789760659.538120:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789760659.538152:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27cc7bb80 x1876699883028352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760659.538166:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883028352:0@lo:400:kworker.0 00000100:00100000:0.0:1789760659.538191:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883028224:0@lo:400:kworker.0 00000100:00100000:3.0:1789760659.540211:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883028096:0@lo:400:kworker.0 00000100:00100000:3.0:1789760659.540272:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760659.540299:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883028608:0@lo:400:kworker.0 00000100:00100000:3.0:1789760659.540318:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760659.540351:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789760659.540356:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699883027968:0@lo:400:kworker.0 00000100:00100000:3.0:1789760659.540377:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760659.540398:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1876699883028480:0@lo:400:kworker.0 00000100:00100000:3.0:1789760659.540415:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760659.540443:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883028096 00000100:00100000:3.0:1789760659.540448:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883028096 00000100:00100000:3.0:1789760659.540480:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883028480 00000100:00100000:3.0:1789760659.540482:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883028480 00000100:00100000:3.0:1789760659.540506:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789760659.540513:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883028096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760659.540557:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883028096:12345-0@lo:400:kworker.0 Request processed in 45us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760659.540564:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789760659.540578:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789760659.540583:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876699883028480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760659.540607:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876699883028480:12345-0@lo:400:kworker.0 Request processed in 24us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760659.540631:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789760659.540657:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883028608 00000100:00100000:3.0:1789760659.540661:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883028608 00000100:00100000:3.0:1789760659.540705:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789760659.540713:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883028608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760659.540823:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883028608:12345-0@lo:400:kworker.0 Request processed in 35us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760659.540830:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789760659.540847:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883027968 00000100:00100000:3.0:1789760659.540850:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883027968 00000100:00100000:3.0:1789760659.540873:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789760659.540880:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+19:3311:x1876699883027968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760659.540909:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+19:3311:x1876699883027968:12345-0@lo:400:kworker.0 Request processed in 30us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760659.540915:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789760659.540973:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699883027968:0@lo:400:kworker.0 00000100:00100000:3.0:1789760659.540986:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1876699883028480:0@lo:400:kworker.0 00000100:00100000:3.0:1789760659.540996:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883028096:0@lo:400:kworker.0 00010000:00080000:3.0:1789760659.541007:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27cc7a680 x1876699883028608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760659.541017:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883028608:0@lo:400:kworker.0 00000100:00080000:0.0:1789760659.541465:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789760659.541472:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789760659.664659:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760660.047397:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883028736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760660.047517:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760660.047918:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883028736 00000100:00100000:3.0:1789760660.047930:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883028736 00000100:00100000:3.0:1789760660.048012:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789760660.048023:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883028736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789760660.049084:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760660.049163:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883028736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1132us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760660.049172:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1789760660.049220:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26d329500 x1876699883028736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760676 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760660.049238:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883028736:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789760660.687606:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760661.711174:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760662.137648:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760662.137692:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760662.137732:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760662.137752:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760662.137790:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760662.137935:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863070080 00000100:00100000:3.0:1789760662.137945:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863070080 00000100:00100000:3.0:1789760662.137999:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 229 00000100:00100000:3.0:1789760662.138009:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2348:x1876699863070080:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760662.138076:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2348:x1876699863070080:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 68us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760662.138083:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 229 00000100:00100000:3.0:1789760662.138114:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863070336 00000100:00100000:3.0:1789760662.138118:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863070336 00000100:00100000:3.0:1789760662.138164:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863070208 00000100:00100000:3.0:1789760662.138167:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863070208 00000100:00100000:3.0:1789760662.138187:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:3.0:1789760662.138194:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d32a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2348:x1876699863070336:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760662.138237:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d32a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2348:x1876699863070336:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 42us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760662.138243:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:3.0:1789760662.138258:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:3.0:1789760662.138264:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d32bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863070208:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760662.138427:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d32bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863070208:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 162us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760662.138433:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:0.0:1789760662.138584:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863070592 00000100:00100000:0.0:1789760662.138590:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863070592 00000100:00100000:0.0:1789760662.138752:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863070464 00000100:00100000:0.0:1789760662.138756:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863070464 00000100:00100000:0.0:1789760662.138779:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:0.0:1789760662.138787:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d328000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2348:x1876699863070592:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1789760662.138832:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d328000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2348:x1876699863070592:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 46us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760662.138840:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:0.0:1789760662.138854:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:0.0:1789760662.138861:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d329c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2348:x1876699863070464:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1789760662.138884:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d329c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2348:x1876699863070464:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 23us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760662.138890:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00080000:3.0:1789760662.140364:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789760662.140371:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789760662.140381:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789760662.734991:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760663.118953:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789760663.118974:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883028864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760663.119046:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760663.119149:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883028864 00000100:00100000:3.0:1789760663.119157:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883028864 00000100:00100000:3.0:1789760663.119222:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789760663.119232:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d32b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883028864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760663.119275:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760663.119335:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d32b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883028864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760663.119343:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1789760663.119425:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27cae2300 x1876699883028864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760679 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760663.119442:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883028864:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789760663.119923:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789760663.759681:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760664.655165:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883029120:0@lo:400:kworker.0 00000100:00100000:0.0:1789760664.655248:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760664.655301:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883029632:0@lo:400:kworker.0 00000100:00100000:0.0:1789760664.655324:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760664.655351:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789760664.655357:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699883028992:0@lo:400:kworker.0 00000100:00100000:0.0:1789760664.655381:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760664.655403:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1876699883029504:0@lo:400:kworker.0 00000100:00100000:0.0:1789760664.655434:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760664.655459:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883029248:0@lo:400:kworker.0 00000100:00100000:0.0:1789760664.655479:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760664.655495:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789760664.655499:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883029376:0@lo:400:kworker.0 00000100:00100000:0.0:1789760664.655514:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760664.655538:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883029120 00000100:00100000:0.0:1789760664.655544:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883029120 00000100:00100000:0.0:1789760664.655577:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883029504 00000100:00100000:0.0:1789760664.655580:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883029504 00000100:00100000:0.0:1789760664.655595:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883029248 00000100:00100000:0.0:1789760664.655597:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883029248 00000100:00100000:0.0:1789760664.655610:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789760664.655617:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883029120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760664.655657:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883029120:12345-0@lo:400:kworker.0 Request processed in 41us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760664.655664:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789760664.655678:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789760664.655683:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876699883029504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760664.655703:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876699883029504:12345-0@lo:400:kworker.0 Request processed in 20us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760664.655708:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789760664.655716:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789760664.655721:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883029248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760664.655747:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883029248:12345-0@lo:400:kworker.0 Request processed in 26us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760664.655752:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789760664.655775:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883029632 00000100:00100000:0.0:1789760664.655778:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883029632 00000100:00100000:0.0:1789760664.655819:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883029376 00000100:00100000:0.0:1789760664.655823:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883029376 00000100:00100000:0.0:1789760664.655844:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789760664.655850:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883029632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760664.655878:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883029632:12345-0@lo:400:kworker.0 Request processed in 29us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760664.655884:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789760664.655893:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789760664.655898:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883029376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760664.655933:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883029376:12345-0@lo:400:kworker.0 Request processed in 35us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760664.655938:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789760664.655953:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883028992 00000100:00100000:0.0:1789760664.655956:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883028992 00000100:00100000:0.0:1789760664.655989:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789760664.655995:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:3311:x1876699883028992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760664.656020:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:3311:x1876699883028992:12345-0@lo:400:kworker.0 Request processed in 26us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760664.656025:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00080000:0.0:1789760664.656056:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789760664.656059:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789760664.656086:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27cc7aa00 x1876699883029376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760664.656099:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883029376:0@lo:400:kworker.0 00000100:00100000:0.0:1789760664.656107:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883029248:0@lo:400:kworker.0 00000100:00100000:0.0:1789760664.656139:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699883028992:0@lo:400:kworker.0 00000100:00100000:0.0:1789760664.656148:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1876699883029504:0@lo:400:kworker.0 00000100:00100000:0.0:1789760664.656156:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883029120:0@lo:400:kworker.0 00010000:00080000:0.0:1789760664.656165:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27cc7a300 x1876699883029632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760664.656173:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883029632:0@lo:400:kworker.0 00010000:00010000:3.0:1789760664.783887:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760665.170050:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2513dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883029760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760665.170125:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760665.170984:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883029760 00000100:00100000:2.0:1789760665.170994:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883029760 00000100:00100000:2.0:1789760665.171052:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789760665.171069:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883029760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789760665.171103:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760665.171163:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883029760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760665.171187:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1789760665.171237:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df2513dce00 x1876699883029760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760681 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760665.171259:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2513dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883029760:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789760665.807129:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789760666.410011:0:11230:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789760666.830951:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760667.267282:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760667.267328:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760667.267348:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863070848 00000100:00100000:0.0:1789760667.267358:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863070848 00000100:00100000:2.0:1789760667.267358:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760667.267376:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863070976 00000100:00100000:2.0:1789760667.267379:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863070976 00000100:00100000:0.0:1789760667.267421:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:0.0:1789760667.267432:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863070848:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1789760667.267508:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863070848:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 79us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760667.267515:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:1.0:1789760667.267572:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760667.267689:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760667.267717:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863071104 00000100:00100000:1.0:1789760667.267721:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863071104 00000100:00100000:1.0:1789760667.267747:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863071232 00000100:00100000:1.0:1789760667.267749:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863071232 00000100:00100000:1.0:1789760667.267768:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:1.0:1789760667.267776:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d328700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2347:x1876699863071104:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:1.0:1789760667.267794:0:8482:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e099f5ef04adc4a 00000100:00080000:1.0:1789760667.267826:0:8482:0:(import.c:65:import_set_state_nolock()) ffff8df26cfe7800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789760667.267932:0:8482:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789760667.268626:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863070720 00000100:00100000:3.0:1789760667.268632:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863070720 00000100:00100000:3.0:1789760667.268677:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 231 00000100:00100000:3.0:1789760667.268686:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2351:x1876699863070720:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760667.268727:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2351:x1876699863070720:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 42us (1399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760667.268734:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 231 00010000:00010000:3.0:1789760667.268765:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760667.269698:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:2.0:1789760667.269709:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2351:x1876699863070976:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1789760667.269759:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2351:x1876699863070976:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 53us (2400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760667.269766:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:2.0:1789760667.270296:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:2.0:1789760667.270306:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2347:x1876699863071232:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:2.0:1789760667.270324:0:6694:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e099f5ef04adc51 00000100:00080000:2.0:1789760667.270342:0:6694:0:(import.c:65:import_set_state_nolock()) ffff8df26d417800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789760667.270381:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789760667.270710:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c264b2a-20ff-4f4b-947d-777de3ce523e+2:2347:x1876699863071232:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 405us (3020us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760667.270717:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00010000:00010000:2.0:1789760667.270764:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760667.273338:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d328700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c264b2a-20ff-4f4b-947d-777de3ce523e+2:2347:x1876699863071104:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 5555us (5758us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760667.273352:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00080000:1.0:1789760667.275775:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789760667.275783:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789760667.275786:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789760667.856294:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760668.249069:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2513de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883029888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760668.249164:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760668.249237:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883029888 00000100:00100000:2.0:1789760668.249245:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883029888 00000100:00100000:2.0:1789760668.249302:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789760668.249321:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883029888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789760668.249355:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760668.249395:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883029888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760668.249402:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1789760668.249437:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df2513de680 x1876699883029888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760684 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760668.249455:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2513de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883029888:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789760668.249894:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1789760668.364861:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7c264b2a-20ff-4f4b-947d-777de3ce523e 00000020:00000080:0.0:1789760668.364870:0:6719:0:(genops.c:885:class_export_put()) final put ffff8df26cfe6800/7c264b2a-20ff-4f4b-947d-777de3ce523e 00000020:00000080:3.0:1789760668.365606:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df26cfe6800/7c264b2a-20ff-4f4b-947d-777de3ce523e for lustre-OST0000 00000020:00000080:3.0:1789760668.365661:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df26cfe7800 for lustre-OST0000 00010000:00010000:3.0:1789760668.880097:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789760669.571042:0:11380:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb4d2a450 20000000:00000080:0.0:1789760669.571058:0:11380:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df2687f5000 uarg=0000000000000000 20000000:01000000:0.0:1789760669.571154:0:11380:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789760669.571160:0:11380:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789760669.571165:0:11380:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789760669.576276:0:11381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1789760669.576513:0:11380:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789760669.584276:0:11380:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789760669.584486:0:11380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df241486600/0x3e099f5ef04adc58 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760669.584510:0:11380:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df2778e8a00/0x3e099f5ef04adbfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cf6c expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760669.584519:0:11380:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df2778e8e00/0x3e099f5ef04adc0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04adc04 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760669.584525:0:11380:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df241538e00/0x3e099f5ef04adc19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04adc12 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760669.584545:0:11380:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df241539800/0x3e099f5ef04adc27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04adc20 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760669.584551:0:11380:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df241538000/0x3e099f5ef04adc3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cfa4 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760669.584558:0:11380:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df241486600/0x3e099f5ef04adc58 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760669.584599:0:11380:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df241538000/0x3e099f5ef04adc3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cfa4 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760669.584613:0:11380:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df241538000/0x3e099f5ef04adc3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cfa4 expref: 12 pid: 5838 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760669.584713:0:11380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d329180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11380:1876699883030016:192.168.203.12@tcp:104: 00010000:00010000:1.0:1789760669.584918:0:11380:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df241539800/0x3e099f5ef04adc27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e099f5ef04adc20 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760669.584996:0:11380:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df241539800/0x3e099f5ef04adc27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e099f5ef04adc20 expref: 18 pid: 5837 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760669.585008:0:11380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d329500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11380:1876699883030144:0@lo:104: 00000100:00100000:1.0:1789760669.585048:0:11380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789760669.585147:0:11380:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df241538e00/0x3e099f5ef04adc19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e099f5ef04adc12 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760669.585156:0:11380:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df241538e00/0x3e099f5ef04adc19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e099f5ef04adc12 expref: 18 pid: 5838 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760669.585172:0:11380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c653b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11380:1876699883030272:0@lo:104: 00000100:00100000:1.0:1789760669.585195:0:11380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760669.585224:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883030144 00000100:00100000:1.0:1789760669.585230:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883030144 00000100:00100000:1.0:1789760669.585267:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883030272 00000100:00100000:1.0:1789760669.585270:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883030272 00000100:00100000:1.0:1789760669.585284:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789760669.585292:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c651880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e2780560-8e82-4256-94b0-2e524f3bed06+4:11380:x1876699883030144:12345-0@lo:104: 00010000:00010000:1.0:1789760669.587704:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8df241539a00/0x3e099f5ef04adc20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04adc27 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760669.587784:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789760669.587793:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c651880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e2780560-8e82-4256-94b0-2e524f3bed06+4:11380:x1876699883030144:12345-0@lo:104: Request processed in 2499us (2742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760669.587820:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789760669.587853:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789760669.587875:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c650000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e2780560-8e82-4256-94b0-2e524f3bed06+3:11380:x1876699883030272:12345-0@lo:104: 00010000:00010000:1.0:1789760669.587884:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8df241539e00/0x3e099f5ef04adc12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04adc19 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760669.587919:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789760669.587924:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c650000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e2780560-8e82-4256-94b0-2e524f3bed06+3:11380:x1876699883030272:12345-0@lo:104: Request processed in 65us (2729us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760669.588030:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1789760669.588050:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789760669.588056:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8df241539a00/0x3e099f5ef04adc20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04adc27 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760669.588077:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241539a00 already unused, calling callback (ffffffffc1be8c20) 10000000:00010000:1.0:1789760669.588090:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8df241539a00/0x3e099f5ef04adc20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e099f5ef04adc27 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760669.588100:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8df241539a00/0x3e099f5ef04adc20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e099f5ef04adc27 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789760669.588107:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8df241539a00/0x3e099f5ef04adc20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e099f5ef04adc27 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760669.588113:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789760669.588145:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8df241539a00/0x3e099f5ef04adc20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04adc27 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760669.588151:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789760669.588167:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8df241539a00/0x3e099f5ef04adc20 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04adc27 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760669.588174:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8df241539a00/0x3e099f5ef04adc20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04adc27 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760669.588186:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789760669.588189:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8df241539e00/0x3e099f5ef04adc12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04adc19 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760669.588195:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241539e00 already unused, calling callback (ffffffffc1be8c20) 10000000:00010000:1.0:1789760669.588197:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8df241539e00/0x3e099f5ef04adc12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e099f5ef04adc19 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760669.588213:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8df241539e00/0x3e099f5ef04adc12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e099f5ef04adc19 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789760669.588218:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8df241539e00/0x3e099f5ef04adc12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e099f5ef04adc19 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760669.588223:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789760669.588236:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8df241539e00/0x3e099f5ef04adc12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04adc19 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760669.588242:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789760669.588248:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8df241539e00/0x3e099f5ef04adc12 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04adc19 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760669.588254:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8df241539e00/0x3e099f5ef04adc12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04adc19 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760669.588265:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760669.588266:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760669.588268:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760669.588407:0:11380:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df2778e8e00/0x3e099f5ef04adc0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e099f5ef04adc04 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760669.588418:0:11380:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8df2778e8e00/0x3e099f5ef04adc0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e099f5ef04adc04 expref: 18 pid: 5837 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760669.588429:0:11380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c652d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11380:1876699883030656:0@lo:104: 00000100:00100000:1.0:1789760669.588461:0:11380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789760669.588488:0:11380:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df2778e8a00/0x3e099f5ef04adbfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cf6c expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760669.588503:0:11380:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df2778e8a00/0x3e099f5ef04adbfd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cf6c expref: 12 pid: 5839 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760669.588512:0:11380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c650e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11380:1876699883030784:192.168.203.12@tcp:104: 00000100:00100000:1.0:1789760669.588551:0:11380:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df258495000 going to sleep for 11 seconds 00000100:00100000:1.0:1789760669.588569:0:11380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d329500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11380:1876699883030144:0@lo:104: 00000100:00100000:1.0:1789760669.588577:0:11380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c653b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11380:1876699883030272:0@lo:104: 00000100:00100000:3.0:1789760669.588660:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883030400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789760669.588691:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760669.588721:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789760669.588727:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883030528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789760669.588754:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760669.588782:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883030400 00000100:00100000:3.0:1789760669.588788:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883030400 00010000:00010000:3.0:1789760669.588831:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df241539800/0x3e099f5ef04adc27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04adc20 expref: 19 pid: 5837 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760669.588851:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883030528 00000100:00100000:3.0:1789760669.588854:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883030528 00010000:00010000:3.0:1789760669.588874:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df241538e00/0x3e099f5ef04adc19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04adc12 expref: 20 pid: 5838 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760669.588893:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789760669.588900:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df260392050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2780560-8e82-4256-94b0-2e524f3bed06+20:3310:x1876699883030400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789760669.588908:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760669.588912:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df241539800/0x3e099f5ef04adc27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04adc20 expref: 20 pid: 5837 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.588920:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df241539800/0x3e099f5ef04adc27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e099f5ef04adc20 expref: 20 pid: 5837 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.589039:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241539800/0x3e099f5ef04adc27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e099f5ef04adc20 expref: 20 pid: 5837 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.589053:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760669.589174:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df260392050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883030400:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760669.589181:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789760669.589218:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789760669.589224:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2780560-8e82-4256-94b0-2e524f3bed06+18:3310:x1876699883030528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789760669.589239:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760669.589244:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df241538e00/0x3e099f5ef04adc19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04adc12 expref: 18 pid: 5838 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.589252:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df241538e00/0x3e099f5ef04adc19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e099f5ef04adc12 expref: 18 pid: 5838 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.589262:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241538e00/0x3e099f5ef04adc19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e099f5ef04adc12 expref: 18 pid: 5838 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.589271:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760669.589358:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2780560-8e82-4256-94b0-2e524f3bed06+17:3310:x1876699883030528:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760669.589366:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789760669.589400:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883030528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789760669.589408:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883030400:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789760669.589599:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760669.589665:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883030656 00000100:00100000:0.0:1789760669.589670:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883030656 00000100:00100000:0.0:1789760669.589708:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789760669.589715:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c651500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e2780560-8e82-4256-94b0-2e524f3bed06+3:11380:x1876699883030656:12345-0@lo:104: 00010000:00010000:0.0:1789760669.589724:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff8df241486e00/0x3e099f5ef04adc04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04adc0b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760669.589763:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789760669.589767:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c651500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e2780560-8e82-4256-94b0-2e524f3bed06+3:11380:x1876699883030656:12345-0@lo:104: Request processed in 54us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760669.589773:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789760669.589924:0:11380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c652d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11380:1876699883030656:0@lo:104: 00010000:00010000:3.0:1789760669.590047:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760669.590053:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff8df241486e00/0x3e099f5ef04adc04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e099f5ef04adc0b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.590059:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241486e00 already unused, calling callback (ffffffffc1be8c20) 10000000:00010000:3.0:1789760669.590062:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff8df241486e00/0x3e099f5ef04adc04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e099f5ef04adc0b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.590070:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff8df241486e00/0x3e099f5ef04adc04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e099f5ef04adc0b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760669.590076:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff8df241486e00/0x3e099f5ef04adc04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e099f5ef04adc0b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760669.590152:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789760669.590184:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff8df241486e00/0x3e099f5ef04adc04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04adc0b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.590191:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760669.590218:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff8df241486e00/0x3e099f5ef04adc04 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04adc0b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.590224:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff8df241486e00/0x3e099f5ef04adc04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e099f5ef04adc0b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.590238:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760669.590240:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760669.590241:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760669.590383:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cae1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699883030912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789760669.590415:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760669.590476:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883030912 00000100:00100000:3.0:1789760669.590481:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883030912 00010000:00010000:3.0:1789760669.590498:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df2778e8e00/0x3e099f5ef04adc0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04adc04 expref: 17 pid: 5837 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760669.590525:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789760669.590532:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2780560-8e82-4256-94b0-2e524f3bed06+17:3308:x1876699883030912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789760669.590540:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760669.590544:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df2778e8e00/0x3e099f5ef04adc0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e099f5ef04adc04 expref: 17 pid: 5837 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.590552:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df2778e8e00/0x3e099f5ef04adc0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e099f5ef04adc04 expref: 17 pid: 5837 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.590564:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df2778e8e00/0x3e099f5ef04adc0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e099f5ef04adc04 expref: 17 pid: 5837 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760669.590580:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760669.590616:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2780560-8e82-4256-94b0-2e524f3bed06+16:3308:x1876699883030912:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760669.590706:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cae1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699883030912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789760669.590772:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789760669.595745:0:11380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d329180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11380:1876699883030016:192.168.203.12@tcp:104: 00000100:00100000:1.0:1789760669.595762:0:11380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c650e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11380:1876699883030784:192.168.203.12@tcp:104: 00010000:00010000:1.0:1789760669.595796:0:11380:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df241486600/0x3e099f5ef04adc58 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760669.598434:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760669.598520:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760669.598667:0:7645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863071360 00000100:00100000:0.0:1789760669.598675:0:7645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863071360 00010000:00010000:0.0:1789760669.598708:0:7645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df241538000/0x3e099f5ef04adc3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cfa4 expref: 13 pid: 5838 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760669.598736:0:7645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863071488 00000100:00100000:0.0:1789760669.598739:0:7645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863071488 00010000:00010000:0.0:1789760669.598748:0:7645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df2778e8a00/0x3e099f5ef04adbfd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cf6c expref: 14 pid: 5839 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760669.598775:0:7645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:0.0:1789760669.598784:0:7645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cae1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:940dde3d-5669-46e3-a0d8-2c83dea985ec+14:2349:x1876699863071360:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789760669.598796:0:7645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760669.598826:0:7645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df241538000/0x3e099f5ef04adc3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cfa4 expref: 14 pid: 5838 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760669.598850:0:7645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df241538000/0x3e099f5ef04adc3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cfa4 expref: 14 pid: 5838 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760669.598875:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241538000/0x3e099f5ef04adc3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cfa4 expref: 14 pid: 5838 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760669.598891:0:7645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760669.598941:0:7645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cae1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2349:x1876699863071360:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 159us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760669.598948:0:7645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:0.0:1789760669.598964:0:7645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:0.0:1789760669.598981:0:7645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:940dde3d-5669-46e3-a0d8-2c83dea985ec+12:2351:x1876699863071488:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789760669.598988:0:7645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760669.598992:0:7645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df2778e8a00/0x3e099f5ef04adbfd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cf6c expref: 12 pid: 5839 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760669.599001:0:7645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df2778e8a00/0x3e099f5ef04adbfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cf6c expref: 12 pid: 5839 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760669.599011:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df2778e8a00/0x3e099f5ef04adbfd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cf6c expref: 12 pid: 5839 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760669.599022:0:7645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df241486600/0x3e099f5ef04adc58 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760669.599031:0:7645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241486600/0x3e099f5ef04adc58 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760669.599055:0:7645:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df241486600/0x3e099f5ef04adc58 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760669.599062:0:7645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df241486600/0x3e099f5ef04adc58 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760669.599069:0:7645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df241486600/0x3e099f5ef04adc58 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760669.599075:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df241486600/0x3e099f5ef04adc58 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760669.599092:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241486600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760669.599096:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df241486600/0x3e099f5ef04adc58 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760669.599104:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df241486600/0x3e099f5ef04adc58 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760669.599117:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df241486600/0x3e099f5ef04adc58 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760669.599126:0:7645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760669.599144:0:7645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:940dde3d-5669-46e3-a0d8-2c83dea985ec+11:2351:x1876699863071488:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 174us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760669.599150:0:7645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 29 00010000:00010000:1.0:1789760669.601568:0:11380:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df241486600/0x3e099f5ef04adc58 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760669.601584:0:11380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df241486600/0x3e099f5ef04adc58 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760669.601592:0:11380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df241486600/0x3e099f5ef04adc58 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760669.775104:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876699883031040:0@lo:400:kworker.0 00000100:00100000:1.0:1789760669.775173:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760669.775228:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883031552:0@lo:400:kworker.0 00000100:00100000:3.0:1789760669.775263:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1876699883031168:0@lo:400:kworker.0 00000100:00100000:3.0:1789760669.775308:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760669.775346:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789760669.775353:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883031296:0@lo:400:kworker.0 00000100:00100000:3.0:1789760669.775380:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760669.775417:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883031040 00000100:00100000:3.0:1789760669.775424:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883031040 00000100:00100000:3.0:1789760669.775462:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883031168 00000100:00100000:3.0:1789760669.775466:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883031168 00000100:00100000:1.0:1789760669.775475:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760669.775501:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789760669.775510:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876699883031040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760669.775512:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789760669.775521:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1876699883031424:0@lo:400:kworker.0 00000100:00100000:2.0:1789760669.777505:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789760669.777521:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876699883031168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760669.780872:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876699883031040:12345-0@lo:400:kworker.0 Request processed in 5344us (5680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760669.780887:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789760669.780925:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789760669.780945:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760669.781003:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876699883031040:0@lo:400:kworker.0 00000100:00100000:1.0:1789760669.781272:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883031296 00000100:00100000:1.0:1789760669.781280:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883031296 00000100:00100000:1.0:1789760669.781322:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883031552 00000100:00100000:1.0:1789760669.781325:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883031552 00000100:00100000:1.0:1789760669.781352:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789760669.781360:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883031296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760669.781429:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883031296:12345-0@lo:400:kworker.0 Request processed in 70us (6048us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760669.781436:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789760669.781516:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789760669.781525:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883031552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760669.781603:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883031552:12345-0@lo:400:kworker.0 Request processed in 79us (6129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760669.781609:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789760669.782233:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883031424 00000100:00100000:3.0:1789760669.782239:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883031424 00000100:00100000:3.0:1789760669.782279:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789760669.782287:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876699883031424:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1789760669.782412:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27c652300 x1876699883031552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760669.782424:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883031552:0@lo:400:kworker.0 00000100:00100000:3.0:1789760669.783376:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876699883031424:12345-0@lo:400:kworker.0 Request processed in 1086us (2448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760669.783393:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:3.0:1789760669.783419:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789760669.783424:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789760669.783451:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27c653b80 x1876699883031296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760669.783463:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883031296:0@lo:400:kworker.0 00000100:00100000:3.0:1789760669.783492:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1876699883031424:0@lo:400:kworker.0 00000100:00100000:2.0:1789760669.785513:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876699883031168:12345-0@lo:400:kworker.0 Request processed in 7989us (10196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760669.785526:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789760669.785661:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1876699883031168:0@lo:400:kworker.0 00010000:00010000:1.0:1789760669.903539:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760670.294781:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789760670.294821:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883031680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760670.295182:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760670.295752:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883031680 00000100:00100000:0.0:1789760670.295761:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883031680 00000100:00100000:0.0:1789760670.295836:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789760670.297111:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883031680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789760670.297161:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760670.297233:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883031680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1388us (2050us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760670.297240:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1789760670.297288:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df26d329500 x1876699883031680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760686 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760670.297307:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883031680:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1789760670.365329:0:7658:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7c264b2a-20ff-4f4b-947d-777de3ce523e 00000020:00000080:0.0:1789760670.365337:0:7658:0:(genops.c:885:class_export_put()) final put ffff8df26d412800/7c264b2a-20ff-4f4b-947d-777de3ce523e 00000020:00000080:0.0:1789760670.365368:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df26d412800/7c264b2a-20ff-4f4b-947d-777de3ce523e for lustre-OST0001 00000020:00000080:0.0:1789760670.365409:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df26d417800 for lustre-OST0001 00010000:00010000:0.0:1789760670.927935:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789760671.182981:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789760671.182989:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df26cd8e800 from 7 10000000:01000000:1.0:1789760671.182995:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789760671.183047:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241486600/0x3e099f5ef04adc5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760671.183059:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8df241486600/0x3e099f5ef04adc5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760671.183072:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8df241486600/0x3e099f5ef04adc5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760671.183099:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c653480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883031808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789760671.183174:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760671.185967:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df258495540 going to sleep for 11 seconds 00000100:00100000:3.0:1789760671.186103:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883031808 00000100:00100000:3.0:1789760671.186114:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883031808 00000100:00100000:3.0:1789760671.186215:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789760671.186226:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+16:5842:x1876699883031808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789760671.186241:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760671.186261:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df2778e8e00/0x3e099f5ef04adc66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04adc5f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760671.186288:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df2778e8e00/0x3e099f5ef04adc66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04adc5f expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760671.186299:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df2778e8e00/0x3e099f5ef04adc66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04adc5f expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760671.186308:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2778e8e00, rc 0) 00000100:00100000:3.0:1789760671.186415:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+17:5842:x1876699883031808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (3239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760671.186421:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789760671.189942:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c653480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883031808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789760671.189972:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8df241486600/0x3e099f5ef04adc5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adc66 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760671.189984:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8df241486600/0x3e099f5ef04adc5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04adc66 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760671.190061:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2513de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883031936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760671.190124:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760671.190166:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259a80a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789760671.190256:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883031936 00000100:00100000:1.0:1789760671.190263:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883031936 00000100:00100000:1.0:1789760671.190310:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789760671.190320:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+17:5842:x1876699883031936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789760671.190558:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+17:5842:x1876699883031936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760671.190565:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789760671.190648:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2513de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883031936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760671.190677:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2513de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883032064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789760671.190713:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760671.190735:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259a80a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789760671.190789:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883032064 00000100:00100000:1.0:1789760671.190793:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883032064 00000100:00100000:1.0:1789760671.190837:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789760671.190844:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+17:5842:x1876699883032064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789760671.190983:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+17:5842:x1876699883032064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760671.190990:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789760671.191072:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2513de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883032064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789760671.191874:0:11438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789760671.192024:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789760671.192039:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789760671.192048:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241486600/0x3e099f5ef04adc5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adc66 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760671.192058:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8df241486600/0x3e099f5ef04adc5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adc66 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760671.192067:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789760671.192069:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df2598cf000 from 7 10000000:01000000:1.0:1789760671.192071:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789760671.192098:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241486a00/0x3e099f5ef04adc6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760671.192105:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8df241486a00/0x3e099f5ef04adc6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760671.192127:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8df241486a00/0x3e099f5ef04adc6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760671.192145:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c653b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883032192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789760671.192186:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760671.192257:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259a68240 going to sleep for 11 seconds 00000100:00100000:3.0:1789760671.192489:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883032192 00000100:00100000:3.0:1789760671.192495:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883032192 00000100:00100000:3.0:1789760671.192528:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789760671.192537:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247857c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+17:5842:x1876699883032192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789760671.192548:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760671.192560:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df2778e9000/0x3e099f5ef04adc74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04adc6d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760671.192581:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df2778e9000/0x3e099f5ef04adc74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04adc6d expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760671.192592:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df2778e9000/0x3e099f5ef04adc74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04adc6d expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760671.192600:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2778e9000, rc 0) 00000100:00100000:3.0:1789760671.192635:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247857c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+18:5842:x1876699883032192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760671.192641:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789760671.192727:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c653b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883032192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789760671.192739:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8df241486a00/0x3e099f5ef04adc6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adc74 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760671.192748:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8df241486a00/0x3e099f5ef04adc6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04adc74 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760671.192825:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c653b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883032320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789760671.192860:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760671.192881:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259a68240 going to sleep for 11 seconds 00000100:00100000:3.0:1789760671.192930:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883032320 00000100:00100000:3.0:1789760671.192934:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883032320 00000100:00100000:3.0:1789760671.192962:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789760671.192968:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247856450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+18:5842:x1876699883032320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789760671.193174:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247856450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+18:5842:x1876699883032320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 205us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760671.193181:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789760671.193260:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c653b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883032320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789760671.193287:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c653b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883032448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789760671.193325:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760671.193354:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259a68240 going to sleep for 11 seconds 00000100:00100000:3.0:1789760671.196925:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883032448 00000100:00100000:3.0:1789760671.196939:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883032448 00000100:00100000:3.0:1789760671.196992:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789760671.197002:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247854850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+18:5842:x1876699883032448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789760671.197234:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247854850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+18:5842:x1876699883032448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 233us (3908us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760671.197243:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789760671.197377:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c653b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883032448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789760671.198208:0:11439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789760671.198358:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789760671.198375:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789760671.198384:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df241486a00/0x3e099f5ef04adc6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adc74 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760671.198394:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8df241486a00/0x3e099f5ef04adc6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adc74 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760671.198405:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789760671.198407:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df2457ba800 from 7 10000000:01000000:3.0:1789760671.198410:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789760671.198440:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df2778e8000/0x3e099f5ef04adc7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760671.198447:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff8df2778e8000/0x3e099f5ef04adc7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760671.198457:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff8df2778e8000/0x3e099f5ef04adc7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760671.198477:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cae0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883032576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789760671.198524:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760671.198570:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df247933300 going to sleep for 11 seconds 00000100:00100000:1.0:1789760671.198624:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883032576 00000100:00100000:1.0:1789760671.198629:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883032576 00000100:00100000:1.0:1789760671.198669:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789760671.198677:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247856c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+18:5842:x1876699883032576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789760671.198687:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760671.198699:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df241487200/0x3e099f5ef04adc82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e099f5ef04adc7b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760671.198720:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df241487200/0x3e099f5ef04adc82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e099f5ef04adc7b expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760671.198730:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df241487200/0x3e099f5ef04adc82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e099f5ef04adc7b expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760671.198738:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241487200, rc 0) 00000100:00100000:1.0:1789760671.198774:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247856c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:5842:x1876699883032576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760671.198792:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789760671.198879:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cae0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883032576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789760671.198891:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff8df2778e8000/0x3e099f5ef04adc7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adc82 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760671.198900:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff8df2778e8000/0x3e099f5ef04adc7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e099f5ef04adc82 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760671.198947:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c653b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883032704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789760671.198970:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760671.198983:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259a683c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760671.198995:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883032704 00000100:00100000:1.0:1789760671.198998:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883032704 00000100:00100000:1.0:1789760671.199015:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789760671.199021:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247855450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:5842:x1876699883032704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789760671.199221:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247855450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:5842:x1876699883032704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 200us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760671.199227:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789760671.199253:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c653b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883032704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789760671.199277:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c653b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883032832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789760671.199313:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760671.199325:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259a683c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760671.199335:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883032832 00000100:00100000:1.0:1789760671.199338:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883032832 00000100:00100000:1.0:1789760671.199354:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789760671.199366:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247857050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:5842:x1876699883032832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789760671.199489:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247857050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:5842:x1876699883032832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760671.199496:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789760671.199530:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c653b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e2780560-8e82-4256-94b0-2e524f3bed06:5842:1876699883032832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789760671.200158:0:11440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789760671.200200:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789760671.200214:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789760671.200222:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff8df2778e8000/0x3e099f5ef04adc7b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adc82 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760671.200231:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff8df2778e8000/0x3e099f5ef04adc7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e099f5ef04adc82 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760671.414953:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760671.415017:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863071616 00000100:00100000:3.0:1789760671.415026:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863071616 00000100:00100000:3.0:1789760671.415080:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 241 00000100:00100000:3.0:1789760671.415092:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247857850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+11:5588:x1876699863071616:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789760671.415117:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760671.415135:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df2778e9c00/0x3e099f5ef04adc89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2cfce expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760671.415163:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df2778e9c00/0x3e099f5ef04adc89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cfce expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760671.415176:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df2778e9c00/0x3e099f5ef04adc89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cfce expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760671.415186:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2778e9c00, rc 0) 00000100:00100000:3.0:1789760671.415238:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247857850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+12:5588:x1876699863071616:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 149us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760671.415246:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 241 00000100:00100000:3.0:1789760671.417259:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760671.417497:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863071744 00000100:00100000:1.0:1789760671.417504:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863071744 00000100:00100000:1.0:1789760671.417550:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 242 00000100:00100000:1.0:1789760671.417560:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247854c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+12:5588:x1876699863071744:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789760671.417863:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247854c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+12:5588:x1876699863071744:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 303us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760671.417871:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 242 00000100:00100000:0.0:1789760671.426219:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760671.430726:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863071872 00000100:00100000:3.0:1789760671.430740:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863071872 00000100:00100000:3.0:1789760671.430794:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 243 00000100:00100000:3.0:1789760671.430818:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247855050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+12:5588:x1876699863071872:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789760671.431032:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247855050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+12:5588:x1876699863071872:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 228us (4820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760671.431040:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 243 00000100:00100000:1.0:1789760671.440763:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760671.440909:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863072000 00000100:00100000:3.0:1789760671.440918:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863072000 00000100:00100000:3.0:1789760671.440976:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 244 00000100:00100000:3.0:1789760671.440986:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247857450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+12:5588:x1876699863072000:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789760671.441014:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760671.441033:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df2778e9e00/0x3e099f5ef04adc90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2cfd5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760671.441061:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df2778e9e00/0x3e099f5ef04adc90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cfd5 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760671.441084:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df2778e9e00/0x3e099f5ef04adc90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cfd5 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760671.441094:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2778e9e00, rc 0) 00000100:00100000:3.0:1789760671.441155:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247857450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:5588:x1876699863072000:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 171us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760671.441162:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 244 00000100:00100000:1.0:1789760671.458572:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760671.461292:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863072128 00000100:00100000:2.0:1789760671.461306:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863072128 00000100:00100000:2.0:1789760671.461365:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 245 00000100:00100000:2.0:1789760671.461376:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247855850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:5588:x1876699863072128:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789760671.461674:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247855850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:5588:x1876699863072128:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 299us (3112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760671.461684:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 245 00000100:00100000:0.0:1789760671.472221:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760671.472738:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863072256 00000100:00100000:3.0:1789760671.472749:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863072256 00000100:00100000:3.0:1789760671.472825:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 246 00000100:00100000:3.0:1789760671.472835:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247854450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:5588:x1876699863072256:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789760671.473056:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247854450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:5588:x1876699863072256:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 221us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760671.473065:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 246 00010000:00010000:1.0:1789760671.954218:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760672.370646:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760672.370680:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760672.370716:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760672.370906:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863072384 00000100:00100000:1.0:1789760672.370916:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863072384 00000100:00100000:1.0:1789760672.371093:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 247 00000100:00100000:1.0:1789760672.371113:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247856050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2349:x1876699863072384:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1789760672.371181:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247856050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2349:x1876699863072384:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 70us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760672.371189:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 247 00000100:00100000:3.0:1789760672.372074:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863072512 00000100:00100000:3.0:1789760672.372082:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863072512 00000100:00100000:3.0:1789760672.372142:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863072640 00000100:00100000:3.0:1789760672.372145:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863072640 00000100:00100000:3.0:1789760672.372173:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:3.0:1789760672.372181:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863072512:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760672.372243:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863072512:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 63us (1607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760672.372250:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:3.0:1789760672.372266:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:3.0:1789760672.372272:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2349:x1876699863072640:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760672.372294:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2349:x1876699863072640:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 23us (1578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760672.372299:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00080000:2.0:1789760672.372689:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789760672.978190:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789760673.211077:0:11579:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1789760673.358982:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789760673.359005:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883032960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760673.359073:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760673.359143:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883032960 00000100:00100000:2.0:1789760673.359159:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883032960 00000100:00100000:2.0:1789760673.359214:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789760673.359223:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883032960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789760673.359257:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760673.359408:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883032960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 186us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760673.359415:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1789760673.359438:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789760673.359495:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27d0ef800 x1876699883032960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760689 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760673.359513:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883032960:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789760673.998955:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760674.899219:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1876699883033344:0@lo:400:kworker.0 00000100:00100000:1.0:1789760674.899292:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760674.899355:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789760674.899363:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883033472:0@lo:400:kworker.0 00000100:00100000:2.0:1789760674.899380:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699883033088:0@lo:400:kworker.0 00000100:00100000:1.0:1789760674.899393:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760674.899431:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760674.899445:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883033344 00000100:00100000:1.0:1789760674.899453:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883033344 00000100:00100000:2.0:1789760674.899467:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cb23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1876699883033600:0@lo:400:kworker.0 00000100:00100000:2.0:1789760674.899495:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760674.899574:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876699883033216:0@lo:400:kworker.0 00000100:00100000:3.0:1789760674.899607:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883033088 00000100:00100000:3.0:1789760674.899610:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883033088 00000100:00100000:3.0:1789760674.899637:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789760674.899645:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247856850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+19:3308:x1876699883033088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760674.899688:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247856850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+19:3308:x1876699883033088:12345-0@lo:400:kworker.0 Request processed in 43us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760674.899695:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789760674.906850:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760674.910274:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883033600 00000100:00100000:1.0:1789760674.910289:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883033600 00000100:00100000:3.0:1789760674.910485:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789760674.910498:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876699883033344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760674.910597:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876699883033344:12345-0@lo:400:kworker.0 Request processed in 101us (11304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760674.910615:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789760674.910638:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789760674.910644:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876699883033600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760674.910677:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876699883033600:12345-0@lo:400:kworker.0 Request processed in 34us (11181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760674.910683:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789760674.910738:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1876699883033344:0@lo:400:kworker.0 00000100:00100000:3.0:1789760674.910775:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cb23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1876699883033600:0@lo:400:kworker.0 00000100:00100000:3.0:1789760674.910793:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699883033088:0@lo:400:kworker.0 00000100:00100000:2.0:1789760674.911696:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cb20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883033728:0@lo:400:kworker.0 00000100:00100000:2.0:1789760674.911741:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760674.911858:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883033216 00000100:00100000:3.0:1789760674.911866:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883033216 00000100:00100000:3.0:1789760674.911909:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789760674.911916:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876699883033216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760674.911964:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876699883033216:12345-0@lo:400:kworker.0 Request processed in 48us (5121us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760674.911971:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789760674.912009:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876699883033216:0@lo:400:kworker.0 00000100:00080000:0.0:1789760674.912199:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760674.912213:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883033472 00000100:00100000:0.0:1789760674.912218:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883033472 00000100:00100000:0.0:1789760674.912286:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883033728 00000100:00100000:0.0:1789760674.912290:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883033728 00000100:00080000:3.0:1789760674.912340:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789760674.912632:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789760674.912642:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883033472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760674.912698:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883033472:12345-0@lo:400:kworker.0 Request processed in 58us (13304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760674.912704:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789760674.912720:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789760674.912726:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883033728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760674.912759:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883033728:12345-0@lo:400:kworker.0 Request processed in 33us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760674.912765:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1789760674.912865:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27cb20380 x1876699883033728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760674.912877:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cb20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883033728:0@lo:400:kworker.0 00010000:00080000:3.0:1789760674.912908:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27c653480 x1876699883033472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760674.912936:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883033472:0@lo:400:kworker.0 00010000:00010000:3.0:1789760675.023124:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760675.407902:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789760675.410531:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cb20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883033856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760675.410615:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760675.411005:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883033856 00000100:00100000:3.0:1789760675.411015:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883033856 00000100:00100000:3.0:1789760675.411380:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789760675.411391:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883033856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789760675.411437:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760675.411498:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883033856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760675.411505:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1789760675.411585:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27cb20700 x1876699883033856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760691 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760675.411604:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cb20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883033856:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789760676.048079:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789760676.516383:0:11681:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanityn: finish setup 15:44:34 (1789760674) === 00000100:00100000:2.0:1789760676.623949:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760676.623999:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863072768 00000100:00100000:2.0:1789760676.624008:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863072768 00000100:00100000:2.0:1789760676.624065:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:2.0:1789760676.624076:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+6:7648:x1876699863072768:12345-192.168.203.12@tcp:37:bash.0 00000100:00080000:3.0:1789760676.626629:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760676.627790:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+6:7648:x1876699863072768:12345-192.168.203.12@tcp:37:bash.0 Request processed in 3706us (3840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760676.627840:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:2.0:1789760676.650877:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760676.650909:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863072896 00000100:00100000:2.0:1789760676.650918:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863072896 00000100:00100000:2.0:1789760676.650969:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:2.0:1789760676.650980:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+6:10024:x1876699863072896:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:2.0:1789760676.651001:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760676.651049:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9200/0x3e099f5ef04adc97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2cfdc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.651118:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adc9e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.651132:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adc9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.651144:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adc9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.651178:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8800/0x3e099f5ef04adca5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.651186:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8800/0x3e099f5ef04adca5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.651199:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8800/0x3e099f5ef04adca5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.651388:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adc9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.651396:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adc9e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.651404:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adc9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.651410:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b8400 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760676.651415:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adc9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.651423:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adc9e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.651436:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df250325e00) 00010000:00010000:2.0:1789760676.651439:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760676.651443:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adc9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.651449:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adc9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.651461:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8800/0x3e099f5ef04adca5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.651467:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8800/0x3e099f5ef04adca5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.651480:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8800/0x3e099f5ef04adca5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.651484:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b8800 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760676.651487:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8800/0x3e099f5ef04adca5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.651494:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8800/0x3e099f5ef04adca5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.651501:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xceb91eaa (ffff8df250325a00) 00010000:00010000:2.0:1789760676.651504:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760676.651507:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8800/0x3e099f5ef04adca5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.651512:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8800/0x3e099f5ef04adca5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.651548:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9200/0x3e099f5ef04adc97 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cfdc expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.651557:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df250325e00) 00010000:00010000:2.0:1789760676.651560:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760676.651564:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9200/0x3e099f5ef04adc97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cfdc expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.651573:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2779b9200, rc 0) 00000100:00100000:2.0:1789760676.651626:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+6:10024:x1876699863072896:12345-192.168.203.12@tcp:101:rm.0 Request processed in 648us (757us total) trans 0 rc 301/301 00000100:00100000:2.0:1789760676.651644:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:2.0:1789760676.658407:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760676.659489:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863073024 00000100:00100000:1.0:1789760676.659503:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863073024 00000100:00100000:1.0:1789760676.659601:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:1.0:1789760676.659612:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+6:10024:x1876699863073024:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:1.0:1789760676.659631:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760676.659651:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241487a00/0x3e099f5ef04adcac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2cfe3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.659715:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486e00/0x3e099f5ef04adcb3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.659738:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486e00/0x3e099f5ef04adcb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.659751:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486e00/0x3e099f5ef04adcb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.659835:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486400/0x3e099f5ef04adcba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.659843:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486400/0x3e099f5ef04adcba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.659850:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486400/0x3e099f5ef04adcba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.660021:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486e00/0x3e099f5ef04adcb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.660039:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486e00/0x3e099f5ef04adcb3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.660046:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486e00/0x3e099f5ef04adcb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.660052:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241486e00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:1.0:1789760676.660056:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486e00/0x3e099f5ef04adcb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.660064:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486e00/0x3e099f5ef04adcb3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.660077:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df250325e00) 00010000:00010000:1.0:1789760676.660084:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760676.660089:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486e00/0x3e099f5ef04adcb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.660095:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486e00/0x3e099f5ef04adcb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.660106:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486400/0x3e099f5ef04adcba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.660112:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486400/0x3e099f5ef04adcba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.660117:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486400/0x3e099f5ef04adcba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.660121:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241486400 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:1.0:1789760676.660124:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486400/0x3e099f5ef04adcba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.660129:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486400/0x3e099f5ef04adcba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.660135:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x59b4378f (ffff8df25b60d700) 00010000:00010000:1.0:1789760676.660138:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760676.660140:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486400/0x3e099f5ef04adcba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.660145:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486400/0x3e099f5ef04adcba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x59b4378f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.660173:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241487a00/0x3e099f5ef04adcac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cfe3 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.660193:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df250325e00) 00010000:00010000:1.0:1789760676.660195:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760676.660199:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241487a00/0x3e099f5ef04adcac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cfe3 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.660209:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241487a00, rc 0) 00000100:00100000:1.0:1789760676.660338:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+6:10024:x1876699863073024:12345-192.168.203.12@tcp:101:rm.0 Request processed in 727us (1939us total) trans 0 rc 301/301 00000100:00100000:1.0:1789760676.660345:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:2.0:1789760676.668366:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760676.668439:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863073152 00000100:00100000:3.0:1789760676.668448:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863073152 00000100:00100000:3.0:1789760676.668508:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:3.0:1789760676.668519:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25855a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+6:10024:x1876699863073152:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:3.0:1789760676.668541:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760676.668563:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04adcc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2cfea expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.668623:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04adcc8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.668636:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04adcc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.668658:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04adcc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.668672:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04adccf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.668679:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04adccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.668685:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04adccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.668913:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04adcc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.668920:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04adcc8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.668926:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04adcc8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.668933:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2778e8a00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760676.668937:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04adcc8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.668945:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04adcc8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.668957:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df250325e00) 00010000:00010000:3.0:1789760676.668960:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760676.668964:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04adcc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.668977:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04adcc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.668987:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04adccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.668992:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04adccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.668997:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04adccf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.669001:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2778e9a00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760676.669004:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04adccf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.669009:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04adccf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.669017:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5948ff0e (ffff8df245dcc500) 00010000:00010000:3.0:1789760676.669019:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760676.669021:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04adccf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.669027:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04adccf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5948ff0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.669182:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04adcc1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cfea expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.669206:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df250325e00) 00010000:00010000:3.0:1789760676.669208:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760676.669212:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04adcc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cfea expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.669221:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2778e8c00, rc 0) 00000100:00100000:3.0:1789760676.669274:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25855a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+6:10024:x1876699863073152:12345-192.168.203.12@tcp:101:rm.0 Request processed in 757us (916us total) trans 0 rc 301/301 00000100:00100000:3.0:1789760676.669281:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:0.0:1789760676.759112:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760676.759161:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760676.759255:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863073408 00000100:00100000:3.0:1789760676.759268:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863073408 00000100:00100000:3.0:1789760676.759335:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:3.0:1789760676.759351:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1da0113a-370d-4d79-883c-54efc174697f+6:10029:x1876699863073408:12345-192.168.203.12@tcp:700:mkdir.0 00000100:00100000:2.0:1789760676.759380:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863073280 00000100:00100000:2.0:1789760676.759396:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863073280 00000100:00100000:2.0:1789760676.759476:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:2.0:1789760676.759488:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+7:2349:x1876699863073280:12345-192.168.203.12@tcp:41:mkdir.0 00000100:00100000:3.0:1789760676.759507:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1da0113a-370d-4d79-883c-54efc174697f+7:10029:x1876699863073408:12345-192.168.203.12@tcp:700:mkdir.0 Request processed in 159us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760676.759516:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000004:00000024:3.0:1789760676.762955:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789760676.763176:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863073280:12345-192.168.203.12@tcp:41:mkdir.0 Request processed in 3681us (4004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760676.763189:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:0.0:1789760676.769389:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760676.769508:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863073664 00000100:00100000:2.0:1789760676.769522:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863073664 00000100:00100000:2.0:1789760676.769651:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1789760676.769662:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+6:10029:x1876699863073664:12345-192.168.203.12@tcp:36:mkdir.0 00010000:00010000:2.0:1789760676.769749:0:7279:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760676.769977:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539600/0x3e099f5ef04adb78 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cf57 expref: 6 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.770002:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df250325e00) 00010000:00010000:2.0:1789760676.770018:0:7279:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789760676.770305:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adcd6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.770321:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adcd6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.770333:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adcd6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.771864:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8200/0x3e099f5ef04adcdd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.771901:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8200/0x3e099f5ef04adcdd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.771986:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8200/0x3e099f5ef04adcdd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760676.774793:0:7279:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789760676.774895:0:7279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adcd6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.774906:0:7279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adcd6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.774922:0:7279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adcd6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.774928:0:7279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b8400 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760676.774932:0:7279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adcd6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.774939:0:7279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adcd6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.774956:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df250325a00) 00010000:00010000:2.0:1789760676.774959:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760676.774963:0:7279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adcd6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.774969:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adcd6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760676.775003:0:7279:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2e6c530 reply state 00000000ebf99aaa transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8200/0x3e099f5ef04adcdd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760676.775013:0:7279:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789760676.775119:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+7:10029:x1876699863073664:12345-192.168.203.12@tcp:36:mkdir.0 Request processed in 5455us (5741us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789760676.775128:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00010000:00010000:1.0:1789760676.778168:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8200/0x3e099f5ef04adcdd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.778190:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8200/0x3e099f5ef04adcdd lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.778200:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8200/0x3e099f5ef04adcdd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.778207:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b8200 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:1.0:1789760676.778212:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8200/0x3e099f5ef04adcdd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.778221:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8200/0x3e099f5ef04adcdd lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.778242:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8df250325900) 00010000:00010000:1.0:1789760676.778246:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760676.778252:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8200/0x3e099f5ef04adcdd lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.778277:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8200/0x3e099f5ef04adcdd lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760676.793562:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760676.794174:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863073792 00000100:00100000:1.0:1789760676.794188:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863073792 00000100:00100000:1.0:1789760676.794308:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:1.0:1789760676.794329:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+6:10030:x1876699863073792:12345-192.168.203.12@tcp:101:chmod.0 00010000:00010000:1.0:1789760676.794356:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760676.794385:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241487a00/0x3e099f5ef04adce4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2cff1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.794472:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486400/0x3e099f5ef04adceb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.794489:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486400/0x3e099f5ef04adceb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.794504:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486400/0x3e099f5ef04adceb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789760676.794561:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789760676.794564:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789760676.794613:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486400/0x3e099f5ef04adceb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.794643:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241487a00/0x3e099f5ef04adce4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cff1 expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.794666:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486400/0x3e099f5ef04adceb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cff1 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.794694:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df25b60d700) 00010000:00010000:1.0:1789760676.794697:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789760676.794701:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241486400, rc 0) 00000100:00100000:1.0:1789760676.794780:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+7:10030:x1876699863073792:12345-192.168.203.12@tcp:101:chmod.0 Request processed in 462us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760676.794788:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:2.0:1789760676.806160:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760676.808247:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863074048 00000100:00100000:3.0:1789760676.808268:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863074048 00000100:00100000:3.0:1789760676.808361:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:3.0:1789760676.808374:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+7:10030:x1876699863074048:12345-192.168.203.12@tcp:36:chmod.0 00010000:00010000:3.0:1789760676.808450:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760676.808500:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486400/0x3e099f5ef04adceb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cff1 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.808525:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df25b60d700) 00010000:00010000:3.0:1789760676.808549:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789760676.808585:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04adcf2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.808600:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04adcf2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760676.808612:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04adcf2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760676.809220:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e73baa1b reply state 00000000f9d9e183 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04adcf2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760676.809234:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789760676.809244:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789760676.809365:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+8:10030:x1876699863074048:12345-192.168.203.12@tcp:36:chmod.0 Request processed in 991us (3212us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789760676.809374:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00010000:00010000:2.0:1789760676.815746:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04adcf2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.815766:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04adcf2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.815773:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04adcf2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.815780:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2778e8c00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760676.815786:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04adcf2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.815793:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04adcf2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.815840:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df245dcc500) 00010000:00010000:2.0:1789760676.815843:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789760676.815848:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04adcf2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.815854:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04adcf2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760676.838224:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760676.846338:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863074176 00000100:00100000:3.0:1789760676.846362:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863074176 00000100:00100000:2.0:1789760676.846928:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:2.0:1789760676.846941:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+7:10031:x1876699863074176:12345-192.168.203.12@tcp:101:chown.0 00010000:00010000:2.0:1789760676.846982:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760676.847013:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04adcf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2cff8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.847107:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8600/0x3e099f5ef04add00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.847125:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8600/0x3e099f5ef04add00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.847140:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8600/0x3e099f5ef04add00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760676.847185:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789760676.847189:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789760676.847239:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8600/0x3e099f5ef04add00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.847269:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04adcf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cff8 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.847291:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8600/0x3e099f5ef04add00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cff8 expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.847300:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df250325a00) 00010000:00010000:2.0:1789760676.847319:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789760676.847323:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2779b8600, rc 0) 00000100:00100000:2.0:1789760676.847417:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+8:10031:x1876699863074176:12345-192.168.203.12@tcp:101:chown.0 Request processed in 478us (9208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760676.847424:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:0.0:1789760676.850684:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760676.850892:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863074304 00000100:00100000:2.0:1789760676.850906:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863074304 00000100:00100000:2.0:1789760676.850992:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:2.0:1789760676.851004:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+8:10031:x1876699863074304:12345-192.168.203.12@tcp:101:chown.0 00010000:00010000:2.0:1789760676.851042:0:7279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760676.851070:0:7279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8a00/0x3e099f5ef04add07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2cfff expref: -99 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.851156:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8e00/0x3e099f5ef04add0e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.851174:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8e00/0x3e099f5ef04add0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.851189:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8e00/0x3e099f5ef04add0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.851207:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04add15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.851215:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04add15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.851223:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04add15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.851356:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8200/0x3e099f5ef04add1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.851364:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8200/0x3e099f5ef04add1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.851371:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8200/0x3e099f5ef04add1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760676.851408:0:7279:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789760676.851412:0:7279:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789760676.851436:0:7279:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8200/0x3e099f5ef04add1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.851451:0:7279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8e00/0x3e099f5ef04add0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.851459:0:7279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8e00/0x3e099f5ef04add0e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.851465:0:7279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8e00/0x3e099f5ef04add0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.851472:0:7279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b8e00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760676.851478:0:7279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8e00/0x3e099f5ef04add0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.851486:0:7279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8e00/0x3e099f5ef04add0e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.851500:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df250325a00) 00010000:00010000:2.0:1789760676.851509:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760676.851516:0:7279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8e00/0x3e099f5ef04add0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.851523:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8e00/0x3e099f5ef04add0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.851551:0:7279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04add15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.851558:0:7279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04add15 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.851565:0:7279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04add15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.851570:0:7279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b8400 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760676.851573:0:7279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04add15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.851579:0:7279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04add15 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.851586:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8df250325e00) 00010000:00010000:2.0:1789760676.851589:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760676.851592:0:7279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04add15 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.851598:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04add15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.851637:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8a00/0x3e099f5ef04add07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cfff expref: 10 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.851665:0:7279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8200/0x3e099f5ef04add1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cfff expref: 9 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.851673:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df250325400) 00010000:00010000:2.0:1789760676.851675:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789760676.851677:0:7279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2779b8200, rc 0) 00000100:00100000:2.0:1789760676.851771:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+9:10031:x1876699863074304:12345-192.168.203.12@tcp:101:chown.0 Request processed in 768us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760676.851779:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:0.0:1789760676.858075:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760676.858337:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863074560 00000100:00100000:2.0:1789760676.858351:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863074560 00000100:00100000:2.0:1789760676.858433:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:2.0:1789760676.858446:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+9:10031:x1876699863074560:12345-192.168.203.12@tcp:36:chown.0 00010000:00010000:2.0:1789760676.858530:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760676.858566:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8200/0x3e099f5ef04add1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cfff expref: 9 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.858592:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df250325400) 00010000:00010000:2.0:1789760676.858618:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789760676.858652:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8a00/0x3e099f5ef04add23 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.858667:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8a00/0x3e099f5ef04add23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760676.858679:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8a00/0x3e099f5ef04add23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760676.906615:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1789760676.907255:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004cadf34a reply state 0000000079b08314 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8a00/0x3e099f5ef04add23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760676.907338:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789760676.907361:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:2.0:1789760676.908898:0:5846:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789760676.908933:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+7:10031:x1876699863074560:12345-192.168.203.12@tcp:36:chown.0 Request processed in 50480us (50864us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789760676.908945:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00010000:00010000:1.0:1789760676.909047:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8a00/0x3e099f5ef04add23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.909060:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8a00/0x3e099f5ef04add23 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.909068:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8a00/0x3e099f5ef04add23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.909076:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b8a00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:1.0:1789760676.909082:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8a00/0x3e099f5ef04add23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.909090:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8a00/0x3e099f5ef04add23 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.909114:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df250325e00) 00010000:00010000:1.0:1789760676.909117:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789760676.909123:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8a00/0x3e099f5ef04add23 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.909130:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8a00/0x3e099f5ef04add23 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760676.953950:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760676.961841:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863074688 00000100:00100000:3.0:1789760676.961858:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863074688 00000100:00100000:2.0:1789760676.962201:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:2.0:1789760676.962219:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+6:10032:x1876699863074688:12345-192.168.203.12@tcp:101:touch.500 00010000:00010000:2.0:1789760676.962252:0:7279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760676.962280:0:7279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8200/0x3e099f5ef04add2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d006 expref: -99 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789760676.964210:0:7279:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1860us 00010000:00010000:1.0:1789760676.996890:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241487a00/0x3e099f5ef04add31 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.996922:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241487a00/0x3e099f5ef04add31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.996954:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241487a00/0x3e099f5ef04add31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.996973:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486e00/0x3e099f5ef04add38 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.996982:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486e00/0x3e099f5ef04add38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.996989:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486e00/0x3e099f5ef04add38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.997612:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486400/0x3e099f5ef04add3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.997624:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486400/0x3e099f5ef04add3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.997634:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486400/0x3e099f5ef04add3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789760676.997666:0:7279:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789760676.997671:0:7279:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789760676.997733:0:7279:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486400/0x3e099f5ef04add3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.997761:0:7279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241487a00/0x3e099f5ef04add31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.997769:0:7279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241487a00/0x3e099f5ef04add31 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.997777:0:7279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241487a00/0x3e099f5ef04add31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.997785:0:7279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241487a00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:1.0:1789760676.997791:0:7279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241487a00/0x3e099f5ef04add31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.997842:0:7279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241487a00/0x3e099f5ef04add31 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.997858:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df250325a00) 00010000:00010000:1.0:1789760676.997862:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760676.997868:0:7279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241487a00/0x3e099f5ef04add31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.997876:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241487a00/0x3e099f5ef04add31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.997892:0:7279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486e00/0x3e099f5ef04add38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.997899:0:7279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486e00/0x3e099f5ef04add38 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.997905:0:7279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486e00/0x3e099f5ef04add38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.997916:0:7279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241486e00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:1.0:1789760676.997919:0:7279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486e00/0x3e099f5ef04add38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.997940:0:7279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486e00/0x3e099f5ef04add38 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.997949:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8df25b60df00) 00010000:00010000:1.0:1789760676.997952:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760676.997955:0:7279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486e00/0x3e099f5ef04add38 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.997961:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486e00/0x3e099f5ef04add38 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.998012:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8200/0x3e099f5ef04add2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d006 expref: 8 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.998031:0:7279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486400/0x3e099f5ef04add3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d006 expref: 7 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760676.998039:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df25b60dd00) 00010000:00010000:1.0:1789760676.998041:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789760676.998043:0:7279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241486400, rc 0) 00000100:00100000:1.0:1789760676.998149:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+7:10032:x1876699863074688:12345-192.168.203.12@tcp:101:touch.500 Request processed in 35934us (44213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760676.999473:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:2.0:1789760677.010919:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760677.011920:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863074944 00000100:00100000:1.0:1789760677.011954:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863074944 00000100:00100000:1.0:1789760677.012030:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:1.0:1789760677.012050:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+7:10032:x1876699863074944:12345-192.168.203.12@tcp:101:touch.500 00010000:00010000:1.0:1789760677.012071:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760677.012093:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076800/0x3e099f5ef04add46 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d00d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.012359:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077800/0x3e099f5ef04add4d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.012373:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077800/0x3e099f5ef04add4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.012384:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077800/0x3e099f5ef04add4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.012445:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076200/0x3e099f5ef04add54 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.012453:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076200/0x3e099f5ef04add54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.012460:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076200/0x3e099f5ef04add54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789760677.013207:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1789760677.013467:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077400/0x3e099f5ef04add5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.013479:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077400/0x3e099f5ef04add5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.013498:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077400/0x3e099f5ef04add5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.013532:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077800/0x3e099f5ef04add4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.013539:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077800/0x3e099f5ef04add4d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.013544:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077800/0x3e099f5ef04add4d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.013549:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f077800 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:1.0:1789760677.013554:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077800/0x3e099f5ef04add4d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.013559:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077800/0x3e099f5ef04add4d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.013570:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df25b60dd00) 00010000:00010000:1.0:1789760677.013573:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760677.013577:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077800/0x3e099f5ef04add4d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.013581:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077800/0x3e099f5ef04add4d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789760677.013593:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005fc24c31 reply state 000000002b1805c9 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076200/0x3e099f5ef04add54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760677.013601:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789760677.013638:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076800/0x3e099f5ef04add46 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d00d expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.013651:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077400/0x3e099f5ef04add5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d00d expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.013658:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8df25b60d700) 00010000:00010000:1.0:1789760677.013660:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789760677.013662:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df24f077400, rc 0) 00000100:00100000:1.0:1789760677.013740:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+10:10032:x1876699863074944:12345-192.168.203.12@tcp:101:touch.500 Request processed in 1692us (2834us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789760677.013748:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 25 00010000:00010000:0.0:1789760677.016604:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076200/0x3e099f5ef04add54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.016621:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076200/0x3e099f5ef04add54 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.016629:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076200/0x3e099f5ef04add54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.016636:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076200 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760677.016642:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076200/0x3e099f5ef04add54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.016652:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076200/0x3e099f5ef04add54 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.016678:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x51ee4c24 (ffff8df25b60d600) 00010000:00010000:0.0:1789760677.016682:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760677.016687:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076200/0x3e099f5ef04add54 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.016694:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076200/0x3e099f5ef04add54 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760677.019884:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760677.020369:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863075200 00000100:00100000:0.0:1789760677.020386:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863075200 00000100:00100000:0.0:1789760677.020455:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:0.0:1789760677.020466:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+9:10032:x1876699863075200:12345-192.168.203.12@tcp:36:touch.500 00010000:00010000:0.0:1789760677.020525:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760677.020552:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077400/0x3e099f5ef04add5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d00d expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.020589:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8df25b60d700) 00010000:00010000:0.0:1789760677.020602:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760677.020658:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67000/0x3e099f5ef04add69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.020671:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67000/0x3e099f5ef04add69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.020681:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67000/0x3e099f5ef04add69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789760677.020840:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e24bc9d1 reply state 00000000a4d05810 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67000/0x3e099f5ef04add69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760677.020850:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789760677.020955:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+10:10032:x1876699863075200:12345-192.168.203.12@tcp:36:touch.500 Request processed in 490us (1085us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789760677.020965:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 26 00010000:00010000:2.0:1789760677.024333:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67000/0x3e099f5ef04add69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.024355:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67000/0x3e099f5ef04add69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.024376:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67000/0x3e099f5ef04add69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.024384:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67000 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760677.024390:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67000/0x3e099f5ef04add69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.024422:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67000/0x3e099f5ef04add69 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.024444:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8df2502f3d00) 00010000:00010000:2.0:1789760677.024447:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760677.024453:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67000/0x3e099f5ef04add69 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.024459:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67000/0x3e099f5ef04add69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760677.024943:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760677.025012:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863075328 00000100:00100000:0.0:1789760677.025028:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863075328 00000100:00100000:0.0:1789760677.025094:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:0.0:1789760677.025105:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+9:10032:x1876699863075328:12345-192.168.203.12@tcp:101:touch.500 00010000:00010000:0.0:1789760677.025138:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760677.025161:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04add70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d014 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.025338:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04add70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d014 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.025445:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04add70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d014 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.025468:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8df2502f3700) 00010000:00010000:0.0:1789760677.025472:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789760677.025475:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df243a66000, rc 0) 00000100:00100000:0.0:1789760677.025536:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+10:10032:x1876699863075328:12345-192.168.203.12@tcp:101:touch.500 Request processed in 433us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760677.025543:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:1.0:1789760677.028469:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760677.028533:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863075456 00000100:00100000:2.0:1789760677.028551:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863075456 00000100:00100000:2.0:1789760677.028619:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:2.0:1789760677.028631:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2347:x1876699863075456:12345-192.168.203.12@tcp:8:touch.500 00010000:00080000:2.0:1789760677.028673:0:8482:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp t0 exp 0000000000000000 cur 281 last 0 00000020:00000080:2.0:1789760677.028732:0:8482:0:(genops.c:1385:class_connect()) connect: client 1da0113a-370d-4d79-883c-54efc174697f, cookie 0x3e099f5ef04add77 00002000:00100000:2.0:1789760677.028747:0:8482:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1da0113a-370d-4d79-883c-54efc174697f/ffff8df1411e7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789760677.028777:0:8482:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789760677.029331:0:8482:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789760677.029440:0:8482:0:(import.c:65:import_set_state_nolock()) ffff8df1411e3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789760677.029543:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2347:x1876699863075456:12345-192.168.203.12@tcp:8:touch.500 Request processed in 911us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760677.029553:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:2.0:1789760677.031977:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760677.032515:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863075584 00000100:00100000:0.0:1789760677.032532:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863075584 00000100:00100000:0.0:1789760677.032643:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00080000:3.0:1789760677.032643:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789760677.032661:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+6:0:x1876699863075584:12345-192.168.203.12@tcp:2:touch.500 00010000:00010000:0.0:1789760677.071031:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789760677.099785:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:2.0:1789760677.099849:0:7658:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1da0113a-370d-4d79-883c-54efc174697f 00000100:00100000:0.0:1789760677.101657:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+5:0:x1876699863075584:12345-192.168.203.12@tcp:2:touch.500 Request processed in 68990us (69685us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789760677.101670:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:0.0:1789760677.110091:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760677.110221:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863075840 00000100:00100000:2.0:1789760677.110230:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863075840 00000100:00100000:2.0:1789760677.110283:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:2.0:1789760677.110293:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+10:10032:x1876699863075840:12345-192.168.203.12@tcp:35:touch.500 00000100:00100000:2.0:1789760677.110729:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+11:10032:x1876699863075840:12345-192.168.203.12@tcp:35:touch.500 Request processed in 436us (648us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789760677.110737:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:1.0:1789760677.135360:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760677.135567:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863075968 00000100:00100000:0.0:1789760677.135577:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863075968 00000100:00100000:0.0:1789760677.136979:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:0.0:1789760677.136999:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+11:10034:x1876699863075968:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:0.0:1789760677.137023:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760677.137045:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04add7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d01b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.137133:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67e00/0x3e099f5ef04add85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.137146:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67e00/0x3e099f5ef04add85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.137157:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67e00/0x3e099f5ef04add85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760677.137192:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789760677.137195:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789760677.137234:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67e00/0x3e099f5ef04add85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.137262:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04add7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d01b expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.137280:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67e00/0x3e099f5ef04add85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d01b expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.137289:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df25b60dd00) 00010000:00010000:0.0:1789760677.137291:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789760677.137294:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df243a67e00, rc 0) 00000100:00100000:0.0:1789760677.137373:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+12:10034:x1876699863075968:12345-192.168.203.12@tcp:101:rm.0 Request processed in 384us (2021us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760677.137381:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:0.0:1789760677.142240:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760677.142364:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863076224 00000100:00100000:1.0:1789760677.142375:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863076224 00000100:00100000:1.0:1789760677.142433:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:1.0:1789760677.142444:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+12:10034:x1876699863076224:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:1.0:1789760677.142464:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760677.142482:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076800/0x3e099f5ef04add8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d022 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789760677.142562:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789760677.142717:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076800/0x3e099f5ef04add8c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d022 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.142731:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df250325a00) 00010000:00010000:1.0:1789760677.142734:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789760677.142743:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076800/0x3e099f5ef04add8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d022 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.142755:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df24f076800, rc 0) 00000100:00100000:1.0:1789760677.142902:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+13:10034:x1876699863076224:12345-192.168.203.12@tcp:101:rm.0 Request processed in 459us (670us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1789760677.142910:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:2.0:1789760677.150449:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760677.150556:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863076352 00000100:00100000:1.0:1789760677.150569:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863076352 00000100:00100000:1.0:1789760677.150636:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:1.0:1789760677.150647:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2476c3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+13:10034:x1876699863076352:12345-192.168.203.12@tcp:37:rm.0 00000100:00100000:1.0:1789760677.155460:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2476c3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+13:10034:x1876699863076352:12345-192.168.203.12@tcp:37:rm.0 Request processed in 4802us (5008us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760677.155474:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:0.0:1789760677.161521:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760677.161706:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863076608 00000100:00100000:3.0:1789760677.161717:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863076608 00000100:00100000:2.0:1789760677.163344:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:2.0:1789760677.163363:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+13:10034:x1876699863076608:12345-192.168.203.12@tcp:35:rm.0 00000100:00100000:2.0:1789760677.163633:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+14:10034:x1876699863076608:12345-192.168.203.12@tcp:35:rm.0 Request processed in 277us (2120us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789760677.163642:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:0.0:1789760677.166913:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760677.167047:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863076864 00000100:00100000:1.0:1789760677.167056:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863076864 00000100:00100000:1.0:1789760677.167120:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:1.0:1789760677.167131:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+14:10034:x1876699863076864:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:1.0:1789760677.167152:0:7279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760677.167171:0:7279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076800/0x3e099f5ef04add9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d029 expref: -99 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.167263:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077800/0x3e099f5ef04adda1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.167276:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077800/0x3e099f5ef04adda1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.167305:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077800/0x3e099f5ef04adda1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789760677.167317:0:7279:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789760677.167432:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076800/0x3e099f5ef04add9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d029 expref: 17 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.167452:0:7279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077800/0x3e099f5ef04adda1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d029 expref: 16 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.167461:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df25b60dd00) 00010000:00010000:1.0:1789760677.167464:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789760677.167467:0:7279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df24f077800, rc 0) 00000100:00100000:1.0:1789760677.167528:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+16:10034:x1876699863076864:12345-192.168.203.12@tcp:101:rm.0 Request processed in 399us (625us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789760677.167535:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:3.0:1789760677.173058:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760677.173222:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863076992 00000100:00100000:1.0:1789760677.173232:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863076992 00000100:00100000:1.0:1789760677.173296:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:1.0:1789760677.173306:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+16:10034:x1876699863076992:12345-192.168.203.12@tcp:41:rm.0 00000004:00000024:1.0:1789760677.173361:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1789760677.173439:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+16:10034:x1876699863076992:12345-192.168.203.12@tcp:41:rm.0 Request processed in 133us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760677.173447:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:2.0:1789760677.185582:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760677.185847:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863077120 00000100:00100000:1.0:1789760677.185857:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863077120 00000100:00100000:1.0:1789760677.185930:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:1.0:1789760677.185941:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+16:10034:x1876699863077120:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:1.0:1789760677.185959:0:7279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760677.185989:0:7279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076800/0x3e099f5ef04addaf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d030 expref: -99 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.186057:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076600/0x3e099f5ef04addb6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.186347:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076600/0x3e099f5ef04addb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.186373:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076600/0x3e099f5ef04addb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.186390:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076a00/0x3e099f5ef04addbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.186397:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076a00/0x3e099f5ef04addbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.186402:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076a00/0x3e099f5ef04addbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.186496:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076e00/0x3e099f5ef04addc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.186504:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076e00/0x3e099f5ef04addc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.186510:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076e00/0x3e099f5ef04addc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789760677.186544:0:7279:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789760677.186548:0:7279:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789760677.186565:0:7279:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076e00/0x3e099f5ef04addc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.186576:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076e00/0x3e099f5ef04addc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.186583:0:7279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076600/0x3e099f5ef04addb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.186589:0:7279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076600/0x3e099f5ef04addb6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.186595:0:7279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076600/0x3e099f5ef04addb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.186601:0:7279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076600 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:1.0:1789760677.186764:0:7279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076600/0x3e099f5ef04addb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.186772:0:7279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076600/0x3e099f5ef04addb6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.186784:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df25b60dd00) 00010000:00010000:1.0:1789760677.186787:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760677.186791:0:7279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076600/0x3e099f5ef04addb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.186940:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076600/0x3e099f5ef04addb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.186967:0:7279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076a00/0x3e099f5ef04addbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.186973:0:7279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076a00/0x3e099f5ef04addbd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.187262:0:7279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076a00/0x3e099f5ef04addbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.187268:0:7279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076a00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:1.0:1789760677.187271:0:7279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076a00/0x3e099f5ef04addbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.187277:0:7279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076a00/0x3e099f5ef04addbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.187285:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x51ee4c24 (ffff8df25b60df00) 00010000:00010000:1.0:1789760677.187288:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760677.187290:0:7279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076a00/0x3e099f5ef04addbd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.187295:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076a00/0x3e099f5ef04addbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.187331:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076800/0x3e099f5ef04addaf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d030 expref: 18 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.187344:0:7279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076e00/0x3e099f5ef04addc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d030 expref: 17 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.187429:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8df2502f3700) 00010000:00010000:1.0:1789760677.187432:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789760677.187434:0:7279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df24f076e00, rc 0) 00000100:00100000:1.0:1789760677.187572:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+17:10034:x1876699863077120:12345-192.168.203.12@tcp:101:rm.0 Request processed in 1632us (1999us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760677.187581:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:2.0:1789760677.192145:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760677.192274:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863077376 00000100:00100000:1.0:1789760677.192283:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863077376 00000100:00100000:1.0:1789760677.192340:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:1.0:1789760677.192348:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+17:10034:x1876699863077376:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:1.0:1789760677.192405:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789760677.192428:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076e00/0x3e099f5ef04addc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d030 expref: 17 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.192450:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04add70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d014 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.192460:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8df2502f3700) 00010000:00010000:1.0:1789760677.192473:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67e00/0x3e099f5ef04add85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d01b expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.192482:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df25b60dd00) 00010000:00010000:1.0:1789760677.192485:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789760677.192502:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077000/0x3e099f5ef04addcb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.192529:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077000/0x3e099f5ef04addcb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.192538:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077000/0x3e099f5ef04addcb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.192551:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077600/0x3e099f5ef04addd2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.192557:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077600/0x3e099f5ef04addd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.192563:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077600/0x3e099f5ef04addd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.192774:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076000/0x3e099f5ef04addd9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.192782:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076000/0x3e099f5ef04addd9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.192789:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076000/0x3e099f5ef04addd9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789760677.193503:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1789760677.193514:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 281306710947ns, next at 282306708522ns, rc = 0 00010000:00010000:1.0:1789760677.193567:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077c00/0x3e099f5ef04adde0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.193576:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077c00/0x3e099f5ef04adde0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.193594:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077c00/0x3e099f5ef04adde0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.193601:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077c00/0x3e099f5ef04adde0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.194102:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077c00/0x3e099f5ef04adde0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.194108:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077c00/0x3e099f5ef04adde0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.194127:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789760677.194148:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076000/0x3e099f5ef04addd9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.194155:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076000/0x3e099f5ef04addd9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.194161:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076000/0x3e099f5ef04addd9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.194167:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076000 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:1.0:1789760677.194171:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076000/0x3e099f5ef04addd9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.194178:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076000/0x3e099f5ef04addd9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.194189:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8df25b60d200) 00010000:00010000:1.0:1789760677.194192:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789760677.194205:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076000/0x3e099f5ef04addd9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.194211:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076000/0x3e099f5ef04addd9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.194228:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077000/0x3e099f5ef04addcb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.194233:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077000/0x3e099f5ef04addcb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.194238:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077000/0x3e099f5ef04addcb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.194242:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f077000 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:1.0:1789760677.194244:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077000/0x3e099f5ef04addcb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.194249:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077000/0x3e099f5ef04addcb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.194256:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df25b60dd00) 00010000:00010000:1.0:1789760677.194258:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760677.194260:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077000/0x3e099f5ef04addcb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760677.194265:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077000/0x3e099f5ef04addcb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789760677.194274:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e5ba5a5d reply state 00000000760c0452 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077600/0x3e099f5ef04addd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760677.194289:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789760677.194391:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+16:10034:x1876699863077376:12345-192.168.203.12@tcp:36:rm.0 Request processed in 2040us (2251us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789760677.194399:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 33 00010000:00010000:3.0:1789760677.194563:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760677.194570:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077c00/0x3e099f5ef04adde0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760677.194577:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f077c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760677.194580:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077c00/0x3e099f5ef04adde0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760677.194587:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077c00/0x3e099f5ef04adde0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760677.194597:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8df25b60d200) 00010000:00010000:3.0:1789760677.194600:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789760677.194602:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077c00/0x3e099f5ef04adde0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760677.194620:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077c00/0x3e099f5ef04adde0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760677.194635:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760677.194637:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760677.194638:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760677.196244:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077600/0x3e099f5ef04addd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.196257:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077600/0x3e099f5ef04addd2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.196264:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077600/0x3e099f5ef04addd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.196269:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f077600 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760677.196273:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077600/0x3e099f5ef04addd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.196279:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077600/0x3e099f5ef04addd2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.196292:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x51ee4c24 (ffff8df25b60d400) 00010000:00010000:0.0:1789760677.196294:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760677.196298:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077600/0x3e099f5ef04addd2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.196303:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077600/0x3e099f5ef04addd2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760677.197689:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760677.197959:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863077632 00000100:00100000:1.0:1789760677.197975:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863077632 00000100:00100000:1.0:1789760677.198027:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:1.0:1789760677.198037:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+15:10034:x1876699863077632:12345-192.168.203.12@tcp:35:rm.0 00000100:00100000:1.0:1789760677.198268:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+16:10034:x1876699863077632:12345-192.168.203.12@tcp:35:rm.0 Request processed in 232us (588us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789760677.198276:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:3.0:1789760677.202742:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760677.202860:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863077888 00000100:00100000:0.0:1789760677.202870:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863077888 00000100:00100000:0.0:1789760677.202937:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:0.0:1789760677.202951:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+16:10034:x1876699863077888:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:0.0:1789760677.203040:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789760677.203085:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077800/0x3e099f5ef04adda1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d029 expref: 16 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.203109:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241486400/0x3e099f5ef04add3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d006 expref: 15 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.203120:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df25b60dd00) 00010000:00010000:0.0:1789760677.203135:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8600/0x3e099f5ef04add00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2cff8 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.203143:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df250325a00) 00010000:00010000:0.0:1789760677.203150:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760677.203174:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66c00/0x3e099f5ef04adde7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.203187:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66c00/0x3e099f5ef04adde7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.203196:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66c00/0x3e099f5ef04adde7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.203208:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04addee lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.203214:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04addee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.203220:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04addee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.203466:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04addf5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.203482:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04addf5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.203489:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04addf5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760677.204122:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789760677.204138:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04addf5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.204147:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04addf5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.204154:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04addf5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.204161:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67a00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760677.204166:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04addf5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.204174:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04addf5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.204185:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8df2502f3f00) 00010000:00010000:0.0:1789760677.204187:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789760677.204192:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04addf5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.204199:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04addf5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.204218:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66c00/0x3e099f5ef04adde7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.204230:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66c00/0x3e099f5ef04adde7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.204237:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66c00/0x3e099f5ef04adde7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.204242:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66c00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760677.204246:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66c00/0x3e099f5ef04adde7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.204253:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66c00/0x3e099f5ef04adde7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.204261:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df2502f3000) 00010000:00010000:0.0:1789760677.204264:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760677.204267:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66c00/0x3e099f5ef04adde7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760677.204272:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66c00/0x3e099f5ef04adde7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789760677.204284:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000281355a2 reply state 0000000076ced999 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04addee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760677.204292:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789760677.204379:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+15:10034:x1876699863077888:12345-192.168.203.12@tcp:36:rm.0 Request processed in 1429us (1642us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789760677.204392:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 34 00010000:00010000:2.0:1789760677.206724:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04addee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.206741:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04addee lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.206749:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04addee lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.206756:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66a00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760677.206761:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04addee lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.206784:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04addee lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.206927:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8df2502f3200) 00010000:00010000:2.0:1789760677.206932:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760677.206937:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04addee lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760677.206944:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04addee lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760677.489890:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760677.489932:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760677.490196:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863078144 00000100:00100000:0.0:1789760677.490206:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863078144 00000100:00100000:0.0:1789760677.490302:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:0.0:1789760677.490313:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2349:x1876699863078144:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1789760677.490383:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2349:x1876699863078144:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 73us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760677.490391:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:2.0:1789760677.490557:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863078016 00000100:00100000:2.0:1789760677.490561:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863078016 00000100:00100000:2.0:1789760677.490601:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 249 00000100:00100000:2.0:1789760677.490609:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247855c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2349:x1876699863078016:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1789760677.490637:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247855c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2349:x1876699863078016:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 30us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760677.490644:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 249 00000100:00080000:3.0:1789760677.491514:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789760678.095829:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760678.479633:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883033984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760678.479713:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760678.479930:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883033984 00000100:00100000:2.0:1789760678.479941:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883033984 00000100:00100000:2.0:1789760678.480013:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789760678.480022:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883033984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789760678.480056:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760678.480095:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883033984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760678.480101:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1789760678.480431:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789760678.480571:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27cae1f80 x1876699883033984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760694 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760678.480591:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883033984:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789760679.118944:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760680.015068:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cb22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1876699883034368:0@lo:400:kworker.0 00000100:00100000:1.0:1789760680.015143:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760680.015217:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789760680.015224:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cb20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883034496:0@lo:400:kworker.0 00000100:00100000:1.0:1789760680.015250:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760680.015295:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883034368 00000100:00100000:1.0:1789760680.015302:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883034368 00000100:00100000:1.0:1789760680.015360:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789760680.015384:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876699883034368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760680.015451:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876699883034368:12345-0@lo:400:kworker.0 Request processed in 70us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760680.015467:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789760680.015492:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883034496 00000100:00100000:1.0:1789760680.015496:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883034496 00000100:00100000:1.0:1789760680.015523:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789760680.015530:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883034496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760680.015560:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883034496:12345-0@lo:400:kworker.0 Request processed in 32us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760680.015567:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1789760680.015583:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789760680.015587:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789760680.015617:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27cb20000 x1876699883034496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760680.015630:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cb20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883034496:0@lo:400:kworker.0 00000100:00100000:1.0:1789760680.015642:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cb22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1876699883034368:0@lo:400:kworker.0 00000100:00100000:2.0:1789760680.015732:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cb22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699883034112:0@lo:400:kworker.0 00000100:00100000:2.0:1789760680.015770:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760680.015834:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cb23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1876699883034624:0@lo:400:kworker.0 00000100:00100000:2.0:1789760680.015858:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760680.015874:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789760680.015880:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cb21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876699883034240:0@lo:400:kworker.0 00000100:00100000:2.0:1789760680.015902:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760680.015919:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cb23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883034752:0@lo:400:kworker.0 00000100:00100000:2.0:1789760680.015941:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760680.015964:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883034752 00000100:00100000:2.0:1789760680.015968:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883034752 00000100:00100000:2.0:1789760680.016010:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789760680.016018:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883034752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760680.016050:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883034624 00000100:00100000:0.0:1789760680.016056:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883034624 00000100:00100000:2.0:1789760680.016060:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883034752:12345-0@lo:400:kworker.0 Request processed in 42us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760680.016068:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789760680.016090:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883034240 00000100:00100000:0.0:1789760680.016094:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883034240 00000100:00100000:2.0:1789760680.016096:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789760680.016107:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876699883034624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760680.016119:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789760680.016130:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876699883034240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760680.016141:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876699883034624:12345-0@lo:400:kworker.0 Request processed in 36us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760680.016148:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:2.0:1789760680.016175:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760680.016176:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876699883034240:12345-0@lo:400:kworker.0 Request processed in 48us (271us total) trans 0 rc 0/0 00000100:00080000:2.0:1789760680.016179:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789760680.016187:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789760680.016200:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cb21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876699883034240:0@lo:400:kworker.0 00010000:00080000:2.0:1789760680.016215:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27cb23b80 x1876699883034752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760680.016237:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cb23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883034752:0@lo:400:kworker.0 00000100:00100000:2.0:1789760680.016251:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cb23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1876699883034624:0@lo:400:kworker.0 00000100:00100000:1.0:1789760680.016543:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883034112 00000100:00100000:1.0:1789760680.016547:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883034112 00000100:00100000:1.0:1789760680.016615:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789760680.016623:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247854050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3308:x1876699883034112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760680.016673:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247854050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3308:x1876699883034112:12345-0@lo:400:kworker.0 Request processed in 51us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760680.016678:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789760680.016747:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cb22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699883034112:0@lo:400:kworker.0 00010000:00010000:3.0:1789760680.147259:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789760680.474682:0:11732:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 77jb: check TBF-UID/GID NRS policy on files that don't belong to us ========================================================== 15:44:38 (1789760678) 00000004:00080000:1.0:1789760680.529172:0:7838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 284642366752ns, next at 285642362828ns, rc = 0 00000100:00100000:1.0:1789760680.529203:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789760680.529232:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cb22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883034880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760680.530253:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760680.530967:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883034880 00000100:00100000:2.0:1789760680.530979:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883034880 00000100:00100000:2.0:1789760680.531051:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789760680.531062:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883034880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789760680.531102:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760680.531181:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883034880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760680.531189:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1789760680.531333:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df27cb22d80 x1876699883034880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760696 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760680.531352:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cb22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883034880:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789760681.167028:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760681.668506:0:11781:0:(nrs_tbf.c:546:nrs_tbf_rule_start()) TBF starts rule@ffff8df258e6dc00 rate 10000 gen 0 00000100:00100000:0.0:1789760681.668559:0:11781:0:(nrs_tbf.c:546:nrs_tbf_rule_start()) TBF starts rule@ffff8df258e6d100 rate 10000 gen 0 00000100:00100000:0.0:1789760681.668685:0:11781:0:(nrs_tbf.c:546:nrs_tbf_rule_start()) TBF starts rule@ffff8df258e6d000 rate 5 gen 0 00000100:00100000:0.0:1789760681.668692:0:11781:0:(nrs_tbf.c:546:nrs_tbf_rule_start()) TBF starts rule@ffff8df258e6dd00 rate 5 gen 0 00000100:00100000:0.0:1789760681.717165:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760681.717311:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863078272 00000100:00100000:2.0:1789760681.717323:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863078272 00000100:00100000:2.0:1789760681.717414:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:2.0:1789760681.717425:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+14:10429:x1876699863078272:12345-192.168.203.12@tcp:101:mkdir.0 00010000:00010000:2.0:1789760681.717449:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760681.717471:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9600/0x3e099f5ef04addfc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d037 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.717536:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8000/0x3e099f5ef04ade03 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.717550:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8000/0x3e099f5ef04ade03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.717564:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8000/0x3e099f5ef04ade03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760681.717616:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789760681.717619:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789760681.717638:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8000/0x3e099f5ef04ade03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.717662:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9600/0x3e099f5ef04addfc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d037 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.717680:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8000/0x3e099f5ef04ade03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d037 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.717688:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df250325200) 00010000:00010000:2.0:1789760681.717691:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789760681.717694:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2779b8000, rc 0) 00000100:00100000:2.0:1789760681.717752:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+15:10429:x1876699863078272:12345-192.168.203.12@tcp:101:mkdir.0 Request processed in 329us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760681.717759:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00080000:3.0:1789760681.719159:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760681.721850:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760681.722024:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863078528 00000100:00100000:0.0:1789760681.722034:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863078528 00000100:00100000:0.0:1789760681.722094:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:0.0:1789760681.722104:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+15:10429:x1876699863078528:12345-192.168.203.12@tcp:36:mkdir.0 00010000:00010000:0.0:1789760681.722158:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760681.722185:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8000/0x3e099f5ef04ade03 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d037 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.722226:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df250325200) 00010000:00010000:0.0:1789760681.722238:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760681.722316:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66200/0x3e099f5ef04ade0a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.722331:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66200/0x3e099f5ef04ade0a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.722340:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66200/0x3e099f5ef04ade0a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.722390:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ade11 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.722398:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ade11 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.722404:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ade11 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760681.723107:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789760681.723117:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66200/0x3e099f5ef04ade0a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.723125:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66200/0x3e099f5ef04ade0a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.723131:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66200/0x3e099f5ef04ade0a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.723138:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66200 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760681.723149:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66200/0x3e099f5ef04ade0a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.723158:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66200/0x3e099f5ef04ade0a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.723169:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df2502f3000) 00010000:00010000:0.0:1789760681.723171:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760681.723175:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66200/0x3e099f5ef04ade0a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.723181:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66200/0x3e099f5ef04ade0a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789760681.723196:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fdca5c76 reply state 0000000005d0fee3 transno 4294967309 ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ade11 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760681.723204:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789760681.723292:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+16:10429:x1876699863078528:12345-192.168.203.12@tcp:36:mkdir.0 Request processed in 1187us (1450us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789760681.723301:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 36 00010000:00010000:0.0:1789760681.727914:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ade11 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.727931:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ade11 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.727939:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ade11 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.727945:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67200 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760681.727950:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ade11 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.727976:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ade11 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.728119:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff8df2502f3f00) 00010000:00010000:0.0:1789760681.728123:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760681.728128:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ade11 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.728135:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ade11 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760681.751141:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760681.751272:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863078656 00000100:00100000:3.0:1789760681.751282:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863078656 00000100:00100000:3.0:1789760681.751367:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:3.0:1789760681.751377:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+15:10430:x1876699863078656:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1789760681.751401:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760681.751422:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04ade18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d03e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.751486:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ade1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.751501:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ade1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.751512:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ade1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760681.751549:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789760681.751553:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789760681.751591:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ade1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.751628:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04ade18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d03e expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.751645:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ade1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d03e expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.751653:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df245dcc400) 00010000:00010000:3.0:1789760681.751655:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789760681.751659:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2778e9a00, rc 0) 00000100:00100000:3.0:1789760681.751721:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+16:10430:x1876699863078656:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 345us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760681.751729:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:2.0:1789760681.754628:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760681.754712:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863078912 00000100:00100000:0.0:1789760681.754722:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863078912 00000100:00100000:0.0:1789760681.754846:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:0.0:1789760681.754857:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+16:10430:x1876699863078912:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1789760681.754875:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760681.755596:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789760681.755627:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ade1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d03e expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.755646:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df245dcc400) 00010000:00010000:0.0:1789760681.755658:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760681.755676:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ade26 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d045 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.755953:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66200/0x3e099f5ef04ade2d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.755966:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66200/0x3e099f5ef04ade2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.756088:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66200/0x3e099f5ef04ade2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.756102:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ade34 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.756109:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ade34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.756115:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ade34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.756185:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ade3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.756193:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ade3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.756199:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ade3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760681.756299:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789760681.756312:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ade3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.756317:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ade3b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.756324:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ade3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.756329:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67600 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760681.756340:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ade3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.756348:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ade3b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.756358:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df2502f3c00) 00010000:00010000:0.0:1789760681.756360:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760681.756364:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ade3b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.756370:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ade3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.756387:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66200/0x3e099f5ef04ade2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.756393:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66200/0x3e099f5ef04ade2d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.756399:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66200/0x3e099f5ef04ade2d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.756404:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66200 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760681.756406:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66200/0x3e099f5ef04ade2d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.756413:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66200/0x3e099f5ef04ade2d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.756419:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df2502f3f00) 00010000:00010000:0.0:1789760681.756421:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760681.756431:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66200/0x3e099f5ef04ade2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.756436:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66200/0x3e099f5ef04ade2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.756445:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ade34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.756451:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ade34 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.756457:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ade34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.756462:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66e00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760681.756465:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ade34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.756471:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ade34 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.756479:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff8df2502f3000) 00010000:00010000:0.0:1789760681.756481:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760681.756484:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ade34 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.756490:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ade34 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.756519:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ade26 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d045 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.756538:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df2502f3f00) 00010000:00010000:0.0:1789760681.756540:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760681.756544:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ade26 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d045 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.756555:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df243a67200, rc 0) 00000100:00100000:0.0:1789760681.756622:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+15:10430:x1876699863078912:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1767us (2002us total) trans 0 rc 301/301 00000100:00100000:0.0:1789760681.756631:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:2.0:1789760681.761815:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760681.761862:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863079040 00000100:00100000:2.0:1789760681.761871:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863079040 00000100:00100000:2.0:1789760681.762302:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:2.0:1789760681.762313:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+15:10430:x1876699863079040:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1789760681.762332:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760681.762363:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04ade42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d04c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.762425:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8600/0x3e099f5ef04ade49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.762438:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8600/0x3e099f5ef04ade49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.762448:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8600/0x3e099f5ef04ade49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760681.762482:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789760681.762485:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789760681.762505:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8600/0x3e099f5ef04ade49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.762526:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04ade42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d04c expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.762541:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8600/0x3e099f5ef04ade49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d04c expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.762550:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df250325700) 00010000:00010000:2.0:1789760681.762553:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789760681.762556:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2779b8600, rc 0) 00000100:00100000:2.0:1789760681.762622:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+16:10430:x1876699863079040:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 312us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760681.762629:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:3.0:1789760681.765590:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760681.765741:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863079296 00000100:00100000:3.0:1789760681.765750:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863079296 00000100:00100000:3.0:1789760681.765828:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:3.0:1789760681.765838:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+16:10430:x1876699863079296:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1789760681.765857:0:7279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760681.765876:0:7279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04ade50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d053 expref: -99 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.765954:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ade57 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.765980:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ade57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.766011:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ade57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.766026:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ade5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.766033:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ade5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.766038:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ade5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760681.766146:0:7279:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789760681.766243:0:7279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ade57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.766252:0:7279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ade57 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.766258:0:7279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ade57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.766264:0:7279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2778e9200 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760681.766268:0:7279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ade57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.766275:0:7279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ade57 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.766286:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df250325700) 00010000:00010000:3.0:1789760681.766289:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760681.766298:0:7279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ade57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.766305:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ade57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.766315:0:7279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ade5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.766321:0:7279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ade5e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.766327:0:7279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ade5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.766331:0:7279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2778e8c00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760681.766334:0:7279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ade5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.766340:0:7279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ade5e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.766346:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff8df245dcc200) 00010000:00010000:3.0:1789760681.766349:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760681.766351:0:7279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ade5e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.766357:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ade5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.766389:0:7279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04ade50 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d053 expref: 18 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.766407:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df250325700) 00010000:00010000:3.0:1789760681.766409:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789760681.766413:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04ade50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d053 expref: 18 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.766421:0:7279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2778e8a00, rc 0) 00000100:00100000:3.0:1789760681.766475:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+17:10430:x1876699863079296:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 639us (894us total) trans 4294967310 rc 301/301 00000100:00100000:3.0:1789760681.766483:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:0.0:1789760681.770662:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760681.770863:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863079552 00000100:00100000:3.0:1789760681.770872:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863079552 00000100:00100000:3.0:1789760681.770990:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:3.0:1789760681.771000:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+17:10430:x1876699863079552:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:3.0:1789760681.771090:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539600/0x3e099f5ef04ade6c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.771105:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539600/0x3e099f5ef04ade6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.771116:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539600/0x3e099f5ef04ade6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760681.772335:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f99d83bc reply state 00000000a031c952 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539600/0x3e099f5ef04ade6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760681.772350:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789760681.772359:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000100:00100000:3.0:1789760681.772462:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+19:10430:x1876699863079552:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 1459us (1806us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789760681.772471:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:1.0:1789760681.784538:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760681.784750:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863079808 00010000:00010000:3.0:1789760681.784751:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539600/0x3e099f5ef04ade6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760681.784759:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863079808 00010000:00010000:3.0:1789760681.784762:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539600/0x3e099f5ef04ade6c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.784769:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539600/0x3e099f5ef04ade6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.784786:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241539600 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760681.784791:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539600/0x3e099f5ef04ade6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.784798:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539600/0x3e099f5ef04ade6c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760681.784832:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00010000:00010000:3.0:1789760681.784836:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df245dcca00) 00010000:00010000:3.0:1789760681.784839:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:0.0:1789760681.784841:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+19:10430:x1876699863079808:12345-192.168.203.12@tcp:35:lfs.0 00010000:00010000:3.0:1789760681.784844:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539600/0x3e099f5ef04ade6c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.784849:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539600/0x3e099f5ef04ade6c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760681.785090:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+19:10430:x1876699863079808:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 249us (560us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789760681.785097:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:0.0:1789760681.800171:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760681.800238:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863079936 00000100:00100000:3.0:1789760681.800248:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863079936 00000100:00100000:3.0:1789760681.800337:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:3.0:1789760681.800348:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+19:10431:x1876699863079936:12345-192.168.203.12@tcp:101:chmod.0 00010000:00010000:3.0:1789760681.800377:0:7279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760681.800396:0:7279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539600/0x3e099f5ef04ade73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d05a expref: -99 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.800454:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241538000/0x3e099f5ef04ade7a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.800469:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241538000/0x3e099f5ef04ade7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.800480:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241538000/0x3e099f5ef04ade7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.800494:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539e00/0x3e099f5ef04ade81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.800501:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539e00/0x3e099f5ef04ade81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.800507:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539e00/0x3e099f5ef04ade81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.800592:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539a00/0x3e099f5ef04ade88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.800600:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539a00/0x3e099f5ef04ade88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.800607:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539a00/0x3e099f5ef04ade88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760681.800636:0:7279:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789760681.800644:0:7279:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789760681.800665:0:7279:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539a00/0x3e099f5ef04ade88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.800678:0:7279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241538000/0x3e099f5ef04ade7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.800685:0:7279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241538000/0x3e099f5ef04ade7a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.800691:0:7279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241538000/0x3e099f5ef04ade7a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.800697:0:7279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241538000 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760681.800701:0:7279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241538000/0x3e099f5ef04ade7a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.800709:0:7279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241538000/0x3e099f5ef04ade7a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.800721:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df250325700) 00010000:00010000:3.0:1789760681.800724:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760681.800728:0:7279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241538000/0x3e099f5ef04ade7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.800735:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241538000/0x3e099f5ef04ade7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.800744:0:7279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539e00/0x3e099f5ef04ade81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.800751:0:7279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539e00/0x3e099f5ef04ade81 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.800766:0:7279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539e00/0x3e099f5ef04ade81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.800783:0:7279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241539e00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760681.800787:0:7279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539e00/0x3e099f5ef04ade81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.800794:0:7279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539e00/0x3e099f5ef04ade81 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.800825:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff8df245dcca00) 00010000:00010000:3.0:1789760681.800828:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760681.800832:0:7279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539e00/0x3e099f5ef04ade81 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.800837:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539e00/0x3e099f5ef04ade81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.800867:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539600/0x3e099f5ef04ade73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d05a expref: 21 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.800880:0:7279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539a00/0x3e099f5ef04ade88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d05a expref: 20 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.800887:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df245dcc200) 00010000:00010000:3.0:1789760681.800889:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789760681.800891:0:7279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241539a00, rc 0) 00000100:00100000:3.0:1789760681.800949:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+20:10431:x1876699863079936:12345-192.168.203.12@tcp:101:chmod.0 Request processed in 602us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760681.800965:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:0.0:1789760681.816662:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760681.816733:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863080192 00000100:00100000:2.0:1789760681.816756:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863080192 00000100:00100000:2.0:1789760681.816846:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:2.0:1789760681.816856:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+20:10431:x1876699863080192:12345-192.168.203.12@tcp:36:chmod.0 00010000:00010000:2.0:1789760681.816921:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760681.816947:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539a00/0x3e099f5ef04ade88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d05a expref: 20 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.816965:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df245dcc200) 00010000:00010000:2.0:1789760681.816975:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789760681.817010:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04ade8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.817023:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04ade8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.817033:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04ade8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760681.817264:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000010b61898 reply state 00000000bd092c46 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04ade8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760681.817274:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789760681.817281:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000100:00100000:2.0:1789760681.817358:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+21:10431:x1876699863080192:12345-192.168.203.12@tcp:36:chmod.0 Request processed in 504us (709us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789760681.817366:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00010000:00010000:2.0:1789760681.827931:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04ade8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.827948:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04ade8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.827968:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04ade8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.827974:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b9e00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760681.827978:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04ade8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.827987:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04ade8f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.828295:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df250325000) 00010000:00010000:2.0:1789760681.828298:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789760681.828302:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04ade8f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.828309:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04ade8f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760681.890688:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760681.890791:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863080320 00000100:00100000:2.0:1789760681.890831:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863080320 00000100:00100000:2.0:1789760681.891055:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:2.0:1789760681.891065:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+20:10435:x1876699863080320:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:2.0:1789760681.891088:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760681.891107:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04ade96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d061 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.891277:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8c00/0x3e099f5ef04ade9d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.891291:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8c00/0x3e099f5ef04ade9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.891318:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8c00/0x3e099f5ef04ade9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.891333:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04adea4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.891341:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04adea4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.891347:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04adea4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.891434:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9800/0x3e099f5ef04adeab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.891441:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9800/0x3e099f5ef04adeab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.891448:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9800/0x3e099f5ef04adeab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760681.891474:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789760681.891478:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789760681.891511:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9800/0x3e099f5ef04adeab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.891522:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8c00/0x3e099f5ef04ade9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.891528:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8c00/0x3e099f5ef04ade9d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.891544:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8c00/0x3e099f5ef04ade9d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.891550:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b8c00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760681.891553:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8c00/0x3e099f5ef04ade9d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.891561:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8c00/0x3e099f5ef04ade9d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.891572:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df250325700) 00010000:00010000:2.0:1789760681.891575:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760681.891578:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8c00/0x3e099f5ef04ade9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.891584:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8c00/0x3e099f5ef04ade9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.891594:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04adea4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.891600:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04adea4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.891606:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04adea4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.891610:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b9a00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760681.891613:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04adea4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.891626:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04adea4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.891635:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff8df250325000) 00010000:00010000:2.0:1789760681.891637:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760681.891640:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04adea4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.891645:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04adea4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.891676:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04ade96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d061 expref: 22 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.891689:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9800/0x3e099f5ef04adeab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d061 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.891697:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df250325c00) 00010000:00010000:2.0:1789760681.891700:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789760681.891702:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2779b9800, rc 0) 00000100:00100000:2.0:1789760681.891962:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+21:10435:x1876699863080320:12345-192.168.203.12@tcp:101:touch.0 Request processed in 896us (1282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760681.891970:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:1.0:1789760681.898317:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760681.898546:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863080576 00000100:00100000:2.0:1789760681.898557:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863080576 00000100:00100000:2.0:1789760681.898617:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:2.0:1789760681.898628:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+21:10435:x1876699863080576:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:2.0:1789760681.898676:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760681.898700:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8800/0x3e099f5ef04adeb2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d068 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.899035:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04adeb9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.899050:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04adeb9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.899063:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04adeb9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.899077:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8e00/0x3e099f5ef04adec0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.899085:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8e00/0x3e099f5ef04adec0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.899091:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8e00/0x3e099f5ef04adec0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789760681.899632:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00000004:00080000:2.0:1789760681.900042:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1789760681.900290:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adec7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.900304:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adec7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.900313:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adec7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.900357:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04adeb9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.900364:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04adeb9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.900371:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04adeb9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.900376:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b9400 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760681.900381:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04adeb9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.900389:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04adeb9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.900401:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df250325c00) 00010000:00010000:2.0:1789760681.900404:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760681.900408:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04adeb9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.900414:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04adeb9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760681.900427:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e832404d reply state 00000000e02d2d6d transno 4294967314 ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8e00/0x3e099f5ef04adec0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760681.900436:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789760681.900468:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8800/0x3e099f5ef04adeb2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d068 expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.900495:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adec7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d068 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.900503:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8df250325b00) 00010000:00010000:2.0:1789760681.900506:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789760681.900508:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2779b8400, rc 0) 00000100:00100000:2.0:1789760681.900587:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+24:10435:x1876699863080576:12345-192.168.203.12@tcp:101:touch.0 Request processed in 1961us (2282us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789760681.900595:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:2.0:1789760681.903542:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760681.904261:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863080832 00000100:00100000:0.0:1789760681.904272:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863080832 00000100:00100000:0.0:1789760681.904336:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:0.0:1789760681.904348:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25847dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+24:10435:x1876699863080832:12345-192.168.203.12@tcp:36:touch.0 00010000:00010000:0.0:1789760681.904400:0:7279:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760681.904438:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adec7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d068 expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.904457:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8df250325b00) 00010000:00010000:0.0:1789760681.904468:0:7279:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760681.904593:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04aded5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.904608:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04aded5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760681.904618:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04aded5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789760681.905273:0:7279:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4cfea46 reply state 000000008f4d0712 transno 4294967315 ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04aded5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760681.905285:0:7279:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789760681.905392:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8e00/0x3e099f5ef04adec0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.905401:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8e00/0x3e099f5ef04adec0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.905408:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8e00/0x3e099f5ef04adec0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.905415:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b8e00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760681.905419:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8e00/0x3e099f5ef04adec0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.905426:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8e00/0x3e099f5ef04adec0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760681.905427:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25847dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+25:10435:x1876699863080832:12345-192.168.203.12@tcp:36:touch.0 Request processed in 1079us (1892us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789760681.905434:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 46 00010000:00010000:3.0:1789760681.905438:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xe7cddcd6 (ffff8df250325d00) 00010000:00010000:3.0:1789760681.905440:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760681.905444:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8e00/0x3e099f5ef04adec0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.905449:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8e00/0x3e099f5ef04adec0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.907464:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04aded5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.907480:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04aded5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.907487:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04aded5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.907493:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66000 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760681.907497:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04aded5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.907506:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04aded5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760681.907518:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00010000:00010000:2.0:1789760681.907521:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8df2502f3f00) 00010000:00010000:2.0:1789760681.907524:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760681.907542:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04aded5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760681.907548:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04aded5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760681.908221:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863080960 00000100:00100000:3.0:1789760681.908232:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863080960 00000100:00100000:3.0:1789760681.908297:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:3.0:1789760681.908307:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+23:10435:x1876699863080960:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:3.0:1789760681.908329:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760681.908357:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539600/0x3e099f5ef04adedc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d06f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.908414:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539600/0x3e099f5ef04adedc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d06f expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.908428:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539600/0x3e099f5ef04adedc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d06f expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760681.908445:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8df245dcca00) 00010000:00010000:3.0:1789760681.908447:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789760681.908450:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241539600, rc 0) 00000100:00100000:3.0:1789760681.908513:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+24:10435:x1876699863080960:12345-192.168.203.12@tcp:101:touch.0 Request processed in 208us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760681.908521:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:1.0:1789760681.910931:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760681.911464:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863081088 00000100:00100000:2.0:1789760681.911474:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863081088 00000100:00100000:2.0:1789760681.911520:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1789760681.911528:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1876699863081088:12345-192.168.203.12@tcp:8:touch.0 00010000:00080000:2.0:1789760681.911558:0:6695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp t0 exp 0000000000000000 cur 286 last 0 00000020:00000080:2.0:1789760681.911587:0:6695:0:(genops.c:1385:class_connect()) connect: client 1da0113a-370d-4d79-883c-54efc174697f, cookie 0x3e099f5ef04adee3 00002000:00100000:2.0:1789760681.911599:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1da0113a-370d-4d79-883c-54efc174697f/ffff8df1411e6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789760681.911623:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789760681.912954:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789760681.912991:0:6695:0:(import.c:65:import_set_state_nolock()) ffff8df26d414000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789760681.913951:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2347:x1876699863081088:12345-192.168.203.12@tcp:8:touch.0 Request processed in 2416us (3022us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760681.913961:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:1.0:1789760681.914072:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760681.914329:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863081344 00000100:00100000:2.0:1789760681.914338:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863081344 00000100:00100000:2.0:1789760681.914403:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:2.0:1789760681.914412:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863081344:12345-192.168.203.12@tcp:2:touch.0 00000100:00100000:2.0:1789760681.915085:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863081344:12345-192.168.203.12@tcp:2:touch.0 Request processed in 670us (1010us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789760681.915093:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00080000:3.0:1789760681.915237:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789760681.917796:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760681.918086:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863081216 00000100:00100000:3.0:1789760681.918096:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863081216 00000100:00080000:2.0:1789760681.918200:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760681.918208:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:3.0:1789760681.918219:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+6:0:x1876699863081216:12345-192.168.203.12@tcp:2:touch.0 00000001:00100000:0.0:1789760681.963474:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1da0113a-370d-4d79-883c-54efc174697f 00000001:00080000:0.0:1789760681.963504:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:1.0:1789760681.964005:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+5:0:x1876699863081216:12345-192.168.203.12@tcp:2:touch.0 Request processed in 45774us (46202us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789760681.964016:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:1.0:1789760681.967556:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760681.967654:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863081600 00000100:00100000:2.0:1789760681.967663:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863081600 00000100:00100000:2.0:1789760681.967715:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:2.0:1789760681.967723:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+24:10435:x1876699863081600:12345-192.168.203.12@tcp:35:touch.0 00000100:00100000:2.0:1789760681.968066:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+25:10435:x1876699863081600:12345-192.168.203.12@tcp:35:touch.0 Request processed in 343us (517us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789760681.968074:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:0.0:1789760682.043152:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760682.043620:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863081856 00000100:00100000:2.0:1789760682.043630:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863081856 00000100:00100000:2.0:1789760682.043702:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:2.0:1789760682.043713:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+25:10439:x1876699863081856:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:2.0:1789760682.043736:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760682.043755:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8800/0x3e099f5ef04adeea lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d076 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.044761:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04adef1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.044791:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04adef1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.045603:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04adef1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.045628:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04adef8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.045639:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04adef8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.045666:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04adef8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789760682.046678:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00000004:00080000:2.0:1789760682.046685:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1789760682.046922:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04adeff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.046935:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04adeff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.046944:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04adeff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.047485:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04adef1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.047494:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04adef1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.047501:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04adef1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.047506:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b9400 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760682.047510:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04adef1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.047517:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04adef1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.047529:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df250325c00) 00010000:00010000:2.0:1789760682.047541:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760682.047547:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04adef1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.047552:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04adef1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760682.047569:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c919c150 reply state 000000007b9f4b8e transno 4294967317 ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04adef8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760682.047577:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789760682.047615:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8800/0x3e099f5ef04adeea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d076 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.047630:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04adeff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d076 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.047637:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df250325000) 00010000:00010000:2.0:1789760682.047640:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789760682.047642:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2779b9a00, rc 0) 00000100:00100000:2.0:1789760682.047901:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+28:10439:x1876699863081856:12345-192.168.203.12@tcp:101:touch.0 Request processed in 4090us (4659us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789760682.047910:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 48 00010000:00010000:3.0:1789760682.049689:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04adef8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.049704:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04adef8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.049711:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04adef8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.049735:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b9e00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760682.049740:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04adef8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.049748:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04adef8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.049762:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x572a2e26 (ffff8df250325500) 00010000:00010000:3.0:1789760682.049765:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760682.049769:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04adef8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.049784:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04adef8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760682.052406:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760682.052541:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863082112 00000100:00100000:3.0:1789760682.052552:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863082112 00000100:00100000:3.0:1789760682.052648:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:3.0:1789760682.052660:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+27:10439:x1876699863082112:12345-192.168.203.12@tcp:36:touch.0 00010000:00010000:3.0:1789760682.052719:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760682.052744:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04adeff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d076 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.052763:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df250325000) 00010000:00010000:3.0:1789760682.052787:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789760682.052874:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539e00/0x3e099f5ef04adf0d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.052893:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539e00/0x3e099f5ef04adf0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.052911:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539e00/0x3e099f5ef04adf0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760682.053101:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3100d74 reply state 000000000269d089 transno 4294967318 ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539e00/0x3e099f5ef04adf0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760682.053111:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789760682.053630:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+28:10439:x1876699863082112:12345-192.168.203.12@tcp:36:touch.0 Request processed in 970us (1230us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1789760682.056456:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:1.0:1789760682.056589:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760682.056766:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863082240 00000100:00100000:0.0:1789760682.056785:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863082240 00000100:00100000:0.0:1789760682.056863:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:0.0:1789760682.056883:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+28:10439:x1876699863082240:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:0.0:1789760682.056923:0:7279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760682.056944:0:7279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04adf14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d07d expref: -99 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.057330:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04adf14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d07d expref: 29 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.057347:0:7279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04adf14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d07d expref: 29 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.057365:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df245dcc700) 00010000:00010000:0.0:1789760682.057368:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789760682.057371:0:7279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df243a67a00, rc 0) 00000100:00100000:0.0:1789760682.057479:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+29:10439:x1876699863082240:12345-192.168.203.12@tcp:101:touch.0 Request processed in 605us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760682.057486:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 50 00010000:00010000:2.0:1789760682.057883:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539e00/0x3e099f5ef04adf0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.057892:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539e00/0x3e099f5ef04adf0d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.057899:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539e00/0x3e099f5ef04adf0d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.057918:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241539e00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760682.057923:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539e00/0x3e099f5ef04adf0d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.057930:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539e00/0x3e099f5ef04adf0d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.057942:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df245dcc700) 00010000:00010000:2.0:1789760682.057944:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760682.057948:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539e00/0x3e099f5ef04adf0d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.057952:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539e00/0x3e099f5ef04adf0d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760682.062354:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760682.062435:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760682.065828:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863082368 00000100:00100000:2.0:1789760682.065843:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863082368 00000100:00100000:2.0:1789760682.065903:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863082496 00000100:00100000:2.0:1789760682.065908:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863082496 00000100:00100000:2.0:1789760682.065936:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:2.0:1789760682.065962:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:2.0:1789760682.065969:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863082496:12345-192.168.203.12@tcp:2:touch.0 00000100:00100000:2.0:1789760682.066441:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863082496:12345-192.168.203.12@tcp:2:touch.0 Request processed in 471us (4004us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789760682.066449:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:2.0:1789760682.066470:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863082368:12345-192.168.203.12@tcp:2:touch.0 00000100:00100000:2.0:1789760682.066990:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+7:2350:x1876699863082368:12345-192.168.203.12@tcp:2:touch.0 Request processed in 1043us (4717us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789760682.067004:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:2.0:1789760682.088360:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760682.088399:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863082752 00000100:00100000:2.0:1789760682.088409:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863082752 00000100:00100000:2.0:1789760682.088457:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:2.0:1789760682.088467:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25847ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+28:10439:x1876699863082752:12345-192.168.203.12@tcp:35:touch.0 00000100:00100000:2.0:1789760682.088927:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25847ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+29:10439:x1876699863082752:12345-192.168.203.12@tcp:35:touch.0 Request processed in 459us (573us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789760682.088935:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000001:00080000:2.0:1789760682.124568:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:2.0:1789760682.140215:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967315 is committed 00000004:00080000:2.0:1789760682.140242:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:2.0:1789760682.140263:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1789760682.140274:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967317 is committed 00000001:00080000:2.0:1789760682.140287:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967318 is committed 00000100:00100000:0.0:1789760682.140495:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883035008:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789760682.140563:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760682.140726:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883035008 00000100:00100000:3.0:1789760682.140734:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883035008 00000100:00100000:3.0:1789760682.140822:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789760682.140832:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883035008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789760682.140858:0:8482:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1789760682.140892:0:8482:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aad94a4, atime: 0x6aad94a4, ctime: 0x6aad94a4, blocks: 0x1 00010000:00010000:3.0:1789760682.140900:0:8482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001948bae7/0x3e099f5ef04adf1b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.140919:0:8482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=286s v=(0 0) 00010000:00010000:3.0:1789760682.140924:0:8482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760682.140930:0:8482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001948bae7/0x3e099f5ef04adf1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.140948:0:8482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001948bae7/0x3e099f5ef04adf1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.141196:0:8482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001948bae7/0x3e099f5ef04adf1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.141208:0:8482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001948bae7/0x3e099f5ef04adf1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.141224:0:8482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789760682.141924:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1876699883035008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1091us (1358us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789760682.141933:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1789760682.142088:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789760682.142100:0:7646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789760682.142107:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001948bae7/0x3e099f5ef04adf1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.142117:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241538000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760682.142121:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001948bae7/0x3e099f5ef04adf1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.142142:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001948bae7/0x3e099f5ef04adf1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.142163:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001948bae7/0x3e099f5ef04adf1b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.142171:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001948bae7/0x3e099f5ef04adf1b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.142191:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760682.142193:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760682.142195:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789760682.142228:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df27cae1880/2, rc 0, transno 4294967302 00000100:00100000:0.0:1789760682.142234:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883035008:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789760682.142364:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760682.142425:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863083008 00000100:00100000:0.0:1789760682.142431:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863083008 00000100:00100000:0.0:1789760682.142481:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:0.0:1789760682.142489:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25847fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+10:10443:x1876699863083008:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1789760682.142509:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760682.142526:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66c00/0x3e099f5ef04adf22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d084 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760682.142604:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789760682.142687:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66c00/0x3e099f5ef04adf22 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d084 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.142709:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df250325700) 00010000:00010000:0.0:1789760682.142711:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789760682.142715:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66c00/0x3e099f5ef04adf22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d084 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.142725:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df243a66c00, rc 0) 00000100:00100000:0.0:1789760682.142778:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25847fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+11:10443:x1876699863083008:12345-192.168.203.12@tcp:101:bash.0 Request processed in 280us (408us total) trans 4294967320 rc 301/301 00000100:00100000:0.0:1789760682.142784:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:2.0:1789760682.151389:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760682.151495:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863083136 00000100:00100000:3.0:1789760682.151506:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863083136 00000100:00100000:3.0:1789760682.151565:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:3.0:1789760682.151575:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25847e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+11:10443:x1876699863083136:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1789760682.151599:0:7279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760682.151617:0:7279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241538e00/0x3e099f5ef04adf30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d08b expref: -99 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.151680:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539800/0x3e099f5ef04adf37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.151692:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539800/0x3e099f5ef04adf37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.151703:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539800/0x3e099f5ef04adf37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760682.151756:0:7279:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789760682.151759:0:7279:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789760682.151787:0:7279:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539800/0x3e099f5ef04adf37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.151834:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241538e00/0x3e099f5ef04adf30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d08b expref: 13 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.151851:0:7279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539800/0x3e099f5ef04adf37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d08b expref: 12 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.151859:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df250325c00) 00010000:00010000:3.0:1789760682.151861:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789760682.151865:0:7279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241539800, rc 0) 00000100:00100000:3.0:1789760682.151932:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25847e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+12:10443:x1876699863083136:12345-192.168.203.12@tcp:101:bash.0 Request processed in 359us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760682.151936:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:2.0:1789760682.166962:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760682.167106:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863083264 00000100:00100000:0.0:1789760682.167117:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863083264 00000100:00100000:0.0:1789760682.167171:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:0.0:1789760682.167180:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2476c2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+12:10443:x1876699863083264:12345-192.168.203.12@tcp:37:bash.0 00000100:00100000:1.0:1789760682.171241:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2476c2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+12:10443:x1876699863083264:12345-192.168.203.12@tcp:37:bash.0 Request processed in 4050us (4277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760682.171254:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:3.0:1789760682.176288:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760682.176400:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863083520 00000100:00100000:2.0:1789760682.176409:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863083520 00000100:00100000:2.0:1789760682.176467:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:2.0:1789760682.176478:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+12:10443:x1876699863083520:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:2.0:1789760682.176713:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+13:10443:x1876699863083520:12345-192.168.203.12@tcp:35:bash.0 Request processed in 237us (435us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789760682.176722:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00010000:00010000:3.0:1789760682.191201:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760682.194060:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760682.194252:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863083648 00000100:00100000:0.0:1789760682.194263:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863083648 00000100:00100000:0.0:1789760682.194551:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:0.0:1789760682.194562:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25847ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+13:10443:x1876699863083648:12345-192.168.203.12@tcp:101:chmod.0 00010000:00010000:0.0:1789760682.194586:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760682.194609:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04adf3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d092 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.194687:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04adf45 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.194705:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04adf45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.194724:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04adf45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.194740:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67e00/0x3e099f5ef04adf4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.194747:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67e00/0x3e099f5ef04adf4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.194753:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67e00/0x3e099f5ef04adf4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.196436:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077a00/0x3e099f5ef04adf53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.196453:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077a00/0x3e099f5ef04adf53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.196463:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077a00/0x3e099f5ef04adf53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789760682.196498:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 0 00000004:00200000:1.0:1789760682.196502:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789760682.196519:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077a00/0x3e099f5ef04adf53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.196537:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077a00/0x3e099f5ef04adf53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.196545:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04adf45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.196551:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04adf45 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.196558:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04adf45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.196564:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66a00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:1.0:1789760682.196568:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04adf45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.196575:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04adf45 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.196586:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df250325c00) 00010000:00010000:1.0:1789760682.196589:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760682.196592:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04adf45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.196598:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04adf45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.196609:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67e00/0x3e099f5ef04adf4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.196615:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67e00/0x3e099f5ef04adf4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.196625:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67e00/0x3e099f5ef04adf4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.196630:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67e00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:1.0:1789760682.196633:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67e00/0x3e099f5ef04adf4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.196639:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67e00/0x3e099f5ef04adf4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.196646:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xe7cddcd6 (ffff8df2502f3c00) 00010000:00010000:1.0:1789760682.196648:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760682.196651:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67e00/0x3e099f5ef04adf4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.196656:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67e00/0x3e099f5ef04adf4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.196689:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04adf3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d092 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.196702:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077a00/0x3e099f5ef04adf53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d092 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.196709:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8df245dcca00) 00010000:00010000:1.0:1789760682.196711:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789760682.196713:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df24f077a00, rc 0) 00000100:00100000:1.0:1789760682.196956:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25847ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+14:10443:x1876699863083648:12345-192.168.203.12@tcp:101:chmod.0 Request processed in 2395us (2903us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760682.196974:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:1.0:1789760682.202395:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760682.202484:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760682.202550:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863083776 00000100:00100000:2.0:1789760682.202559:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863083776 00000100:00100000:2.0:1789760682.202610:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863083904 00000100:00100000:2.0:1789760682.202613:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863083904 00000100:00100000:2.0:1789760682.202642:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:2.0:1789760682.202651:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863083776:12345-192.168.203.12@tcp:101:chmod.0 00010000:00010000:2.0:1789760682.202669:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760682.202690:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fac42dd/0x3e099f5ef04adf5a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d099 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760682.202716:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aad94a9, atime: 0x6aad94a9, ctime: 0x6aad94a9, blocks: 0x1 00010000:00010000:2.0:1789760682.202733:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=286s v=(0 0) 00010000:00010000:2.0:1789760682.202738:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760682.202748:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fac42dd/0x3e099f5ef04adf5a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d099 expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.202767:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000fac42dd/0x3e099f5ef04adf5a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d099 expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.202794:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2779b8a00, rc 0) 00000100:00100000:3.0:1789760682.202894:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:3.0:1789760682.202905:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863083904:12345-192.168.203.12@tcp:101:chmod.0 00010000:00010000:3.0:1789760682.202914:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760682.202925:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009832b5e8/0x3e099f5ef04adf61 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d0a0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760682.202942:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x6aad94a9, atime: 0x6aad94a9, ctime: 0x6aad94a9, blocks: 0x1 00010000:00010000:3.0:1789760682.202964:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=286s v=(0 0) 00010000:00010000:3.0:1789760682.202967:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760682.202974:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009832b5e8/0x3e099f5ef04adf61 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0a0 expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.202986:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009832b5e8/0x3e099f5ef04adf61 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0a0 expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.202995:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241538e00, rc 0) 00000100:00100000:3.0:1789760682.203050:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+7:2349:x1876699863083904:12345-192.168.203.12@tcp:101:chmod.0 Request processed in 148us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760682.203065:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:2.0:1789760682.203230:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+7:2349:x1876699863083776:12345-192.168.203.12@tcp:101:chmod.0 Request processed in 579us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760682.203236:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:3.0:1789760682.209799:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760682.210013:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863084160 00000100:00100000:0.0:1789760682.210024:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863084160 00000100:00100000:0.0:1789760682.210281:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:0.0:1789760682.210292:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+14:10443:x1876699863084160:12345-192.168.203.12@tcp:36:chmod.0 00010000:00010000:0.0:1789760682.210344:0:7279:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760682.210370:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077a00/0x3e099f5ef04adf53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d092 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.210389:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8df245dcca00) 00010000:00010000:0.0:1789760682.210394:0:7279:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760682.210423:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04adf68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.210435:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04adf68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.210444:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04adf68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789760682.210682:0:7279:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000454658fc reply state 0000000012f1194f transno 4294967322 ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04adf68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760682.210692:0:7279:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789760682.210962:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+15:10443:x1876699863084160:12345-192.168.203.12@tcp:36:chmod.0 Request processed in 670us (1187us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1789760682.210969:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:1.0:1789760682.217491:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760682.217536:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760682.217691:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863084288 00000100:00100000:2.0:1789760682.217701:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863084288 00000100:00100000:2.0:1789760682.217755:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863084416 00000100:00100000:2.0:1789760682.217758:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863084416 00000100:00100000:2.0:1789760682.217845:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:2.0:1789760682.217855:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+7:2348:x1876699863084288:12345-192.168.203.12@tcp:2:chmod.0 00002000:00010000:2.0:1789760682.218478:0:8482:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789760682.218482:0:8482:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 1789760681 -> 1789760681 00002000:00010000:2.0:1789760682.218485:0:8482:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 1789760681 -> 1789760681 00002000:00010000:2.0:1789760682.218487:0:8482:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 1789760681 -> 1789760681 00002000:00010000:2.0:1789760682.218489:0:8482:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789760682.218553:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+8:2348:x1876699863084288:12345-192.168.203.12@tcp:2:chmod.0 Request processed in 699us (1069us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789760682.218561:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:2.0:1789760682.218581:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:2.0:1789760682.218589:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+7:2349:x1876699863084416:12345-192.168.203.12@tcp:2:chmod.0 00002000:00010000:2.0:1789760682.218700:0:8482:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789760682.218703:0:8482:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789760681 -> 1789760681 00002000:00010000:2.0:1789760682.218706:0:8482:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789760681 -> 1789760681 00002000:00010000:2.0:1789760682.218707:0:8482:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789760681 -> 1789760681 00002000:00010000:2.0:1789760682.218709:0:8482:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789760682.218741:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+8:2349:x1876699863084416:12345-192.168.203.12@tcp:2:chmod.0 Request processed in 142us (1193us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789760682.218747:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00010000:00010000:3.0:1789760682.221325:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04adf68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.221342:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04adf68 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.221349:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04adf68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.221356:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67600 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760682.221360:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04adf68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.221367:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04adf68 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.221398:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8df245dcca00) 00010000:00010000:3.0:1789760682.221400:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789760682.221405:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04adf68 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.221410:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04adf68 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760682.224655:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760682.224849:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863084544 00000100:00100000:3.0:1789760682.224860:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863084544 00000100:00100000:3.0:1789760682.224917:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:3.0:1789760682.224928:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+14:10443:x1876699863084544:12345-192.168.203.12@tcp:101:chmod.0 00010000:00010000:3.0:1789760682.224950:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760682.224982:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241538000/0x3e099f5ef04adf6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d0a7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.225058:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539e00/0x3e099f5ef04adf76 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.225072:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539e00/0x3e099f5ef04adf76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.225083:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539e00/0x3e099f5ef04adf76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.225098:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539a00/0x3e099f5ef04adf7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.225105:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539a00/0x3e099f5ef04adf7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.225129:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539a00/0x3e099f5ef04adf7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.225449:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675c00/0x3e099f5ef04adf84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.225459:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675c00/0x3e099f5ef04adf84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.225467:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675c00/0x3e099f5ef04adf84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760682.225498:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x6:0x0]: returning size 0 00000004:00200000:3.0:1789760682.225502:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789760682.225519:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675c00/0x3e099f5ef04adf84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.225531:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675c00/0x3e099f5ef04adf84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.225539:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539e00/0x3e099f5ef04adf76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.225545:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539e00/0x3e099f5ef04adf76 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.225553:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539e00/0x3e099f5ef04adf76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.225569:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241539e00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760682.225573:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539e00/0x3e099f5ef04adf76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.225586:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539e00/0x3e099f5ef04adf76 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.225599:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df250325c00) 00010000:00010000:3.0:1789760682.225602:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760682.225606:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539e00/0x3e099f5ef04adf76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.225612:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539e00/0x3e099f5ef04adf76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.225624:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539a00/0x3e099f5ef04adf7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.225629:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539a00/0x3e099f5ef04adf7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.225635:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539a00/0x3e099f5ef04adf7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.225640:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241539a00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760682.225643:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539a00/0x3e099f5ef04adf7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.225649:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539a00/0x3e099f5ef04adf7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.225656:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x572a2e26 (ffff8df245dcc000) 00010000:00010000:3.0:1789760682.225658:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760682.225661:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539a00/0x3e099f5ef04adf7d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.225677:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539a00/0x3e099f5ef04adf7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.225710:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241538000/0x3e099f5ef04adf6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0a7 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.225724:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675c00/0x3e099f5ef04adf84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0a7 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.225732:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df245dcc700) 00010000:00010000:3.0:1789760682.225735:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789760682.225737:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241675c00, rc 0) 00000100:00100000:3.0:1789760682.225861:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+15:10443:x1876699863084544:12345-192.168.203.12@tcp:101:chmod.0 Request processed in 934us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760682.225870:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:2.0:1789760682.235717:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760682.235845:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863084672 00000100:00100000:1.0:1789760682.235856:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863084672 00000100:00100000:1.0:1789760682.235913:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:1.0:1789760682.235923:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+8:2350:x1876699863084672:12345-192.168.203.12@tcp:101:chmod.0 00010000:00010000:1.0:1789760682.236117:0:8482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760682.236142:0:8482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009893b0c0/0x3e099f5ef04adf8b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d0ae expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760682.236173:0:8482:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x6aad94a9, atime: 0x6aad94a9, ctime: 0x6aad94a9, blocks: 0x1 00010000:00010000:1.0:1789760682.236194:0:8482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=286s v=(0 0) 00010000:00010000:1.0:1789760682.236199:0:8482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760682.236209:0:8482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009893b0c0/0x3e099f5ef04adf8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0ae expref: 9 pid: 8482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.236229:0:8482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009893b0c0/0x3e099f5ef04adf8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0ae expref: 9 pid: 8482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.236243:0:8482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df24f076600, rc 0) 00000100:00100000:1.0:1789760682.236346:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+9:2350:x1876699863084672:12345-192.168.203.12@tcp:101:chmod.0 Request processed in 424us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760682.236366:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:2.0:1789760682.238282:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760682.238382:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863084800 00000100:00100000:0.0:1789760682.238391:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863084800 00000100:00100000:0.0:1789760682.238490:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:0.0:1789760682.238501:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+8:2350:x1876699863084800:12345-192.168.203.12@tcp:101:chmod.0 00010000:00010000:0.0:1789760682.238518:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760682.238538:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04adf92 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d0b5 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760682.238565:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x6aad94a9, atime: 0x6aad94a9, ctime: 0x6aad94a9, blocks: 0x1 00010000:00010000:0.0:1789760682.238581:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=286s v=(0 0) 00010000:00010000:0.0:1789760682.238585:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760682.238594:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04adf92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0b5 expref: 9 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.238611:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04adf92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0b5 expref: 9 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.238622:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df243a66200, rc 0) 00000100:00100000:0.0:1789760682.238666:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+9:2350:x1876699863084800:12345-192.168.203.12@tcp:101:chmod.0 Request processed in 168us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760682.238681:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:2.0:1789760682.243961:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760682.245603:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863085056 00000100:00100000:1.0:1789760682.245618:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863085056 00000100:00100000:1.0:1789760682.245694:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:1.0:1789760682.245704:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+15:10443:x1876699863085056:12345-192.168.203.12@tcp:36:chmod.0 00010000:00010000:1.0:1789760682.245757:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760682.245792:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675c00/0x3e099f5ef04adf84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0a7 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.245863:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df245dcc700) 00010000:00010000:1.0:1789760682.245868:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789760682.245900:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076a00/0x3e099f5ef04adf99 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.245913:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076a00/0x3e099f5ef04adf99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.245924:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076a00/0x3e099f5ef04adf99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789760682.246255:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000acca89e5 reply state 0000000013ab48b5 transno 4294967323 ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076a00/0x3e099f5ef04adf99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760682.246265:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789760682.246359:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+16:10443:x1876699863085056:12345-192.168.203.12@tcp:36:chmod.0 Request processed in 657us (2407us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1789760682.246366:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00010000:00010000:0.0:1789760682.248289:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076a00/0x3e099f5ef04adf99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.248305:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076a00/0x3e099f5ef04adf99 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.248311:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076a00/0x3e099f5ef04adf99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.248317:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076a00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760682.248322:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076a00/0x3e099f5ef04adf99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.248329:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076a00/0x3e099f5ef04adf99 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.248345:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df245dcc700) 00010000:00010000:0.0:1789760682.248348:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789760682.248352:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076a00/0x3e099f5ef04adf99 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.248358:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076a00/0x3e099f5ef04adf99 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760682.254206:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760682.254298:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760682.255729:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863085184 00000100:00100000:1.0:1789760682.255758:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863085184 00000100:00100000:1.0:1789760682.255898:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863085312 00000100:00100000:1.0:1789760682.255902:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863085312 00000100:00100000:1.0:1789760682.255931:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:1.0:1789760682.256006:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+9:2349:x1876699863085184:12345-192.168.203.12@tcp:2:chmod.0 00000100:00100000:2.0:1789760682.256006:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:2.0:1789760682.256020:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+9:2349:x1876699863085312:12345-192.168.203.12@tcp:2:chmod.0 00002000:00010000:2.0:1789760682.256207:0:6695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789760682.256211:0:6695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789760681 -> 1789760681 00002000:00010000:2.0:1789760682.256213:0:6695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1789760681 -> 1789760681 00002000:00010000:2.0:1789760682.256216:0:6695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789760681 -> 1789760681 00002000:00010000:2.0:1789760682.256218:0:6695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789760682.256284:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+10:2349:x1876699863085312:12345-192.168.203.12@tcp:2:chmod.0 Request processed in 264us (1985us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789760682.256291:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 31 00002000:00010000:1.0:1789760682.256335:0:8482:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789760682.256339:0:8482:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789760681 -> 1789760681 00002000:00010000:1.0:1789760682.256341:0:8482:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1789760681 -> 1789760681 00002000:00010000:1.0:1789760682.256343:0:8482:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789760681 -> 1789760681 00002000:00010000:1.0:1789760682.256345:0:8482:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789760682.256368:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+10:2349:x1876699863085184:12345-192.168.203.12@tcp:2:chmod.0 Request processed in 367us (2171us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789760682.256374:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:2.0:1789760682.297068:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760682.297156:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863085568 00000100:00100000:3.0:1789760682.297166:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863085568 00000100:00100000:3.0:1789760682.297235:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:3.0:1789760682.297246:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+15:10447:x1876699863085568:12345-192.168.203.12@tcp:101:dd.500 00010000:00010000:3.0:1789760682.297269:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760682.297272:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789760682.297296:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539800/0x3e099f5ef04adf37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d08b expref: 15 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.297315:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df250325c00) 00010000:00010000:3.0:1789760682.297333:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789760682.297360:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674a00/0x3e099f5ef04adfa0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d0bc expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.297709:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04adfa7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.297729:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04adfa7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.297739:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04adfa7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.297753:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04adfae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.297761:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04adfae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.297767:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04adfae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.298636:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04adfb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.298648:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04adfb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.298656:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04adfb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760682.298667:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 0 00010000:00010000:2.0:1789760682.298762:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04adfa7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.298780:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04adfa7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.298786:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04adfa7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.298793:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674e00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760682.298842:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04adfa7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.298851:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04adfa7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.298862:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df250325c00) 00010000:00010000:2.0:1789760682.298865:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760682.298869:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04adfa7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.298876:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04adfa7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.298888:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04adfae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.298894:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04adfae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.298899:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04adfae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.298904:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674200 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760682.298908:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04adfae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.298914:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04adfae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.298921:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xe7cddcd6 (ffff8df245dcc000) 00010000:00010000:2.0:1789760682.298924:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760682.298933:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04adfae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.298939:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04adfae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.299017:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674a00/0x3e099f5ef04adfa0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0bc expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.299036:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04adfb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0bc expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.299043:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8df245dcca00) 00010000:00010000:2.0:1789760682.299045:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789760682.299048:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2779b9400, rc 0) 00000100:00100000:2.0:1789760682.299108:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+16:10447:x1876699863085568:12345-192.168.203.12@tcp:101:dd.500 Request processed in 1863us (2050us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1789760682.299116:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:3.0:1789760682.304080:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760682.304307:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863085824 00000100:00100000:1.0:1789760682.304317:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863085824 00000100:00100000:1.0:1789760682.304440:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:1.0:1789760682.304451:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+16:10447:x1876699863085824:12345-192.168.203.12@tcp:36:dd.500 00010000:00010000:1.0:1789760682.304528:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760682.304555:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04adfb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0bc expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.304575:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8df245dcca00) 00010000:00010000:1.0:1789760682.304580:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789760682.304799:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076800/0x3e099f5ef04adfc3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.304858:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076800/0x3e099f5ef04adfc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.304878:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076800/0x3e099f5ef04adfc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760682.304938:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00000004:00010000:1.0:1789760682.304975:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b530c4f reply state 000000002c82c9bd transno 4294967326 ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076800/0x3e099f5ef04adfc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760682.304984:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789760682.305089:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+18:10447:x1876699863085824:12345-192.168.203.12@tcp:36:dd.500 Request processed in 638us (1017us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1789760682.305096:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 58 00000020:00080000:1.0:1789760682.305102:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789760682.308483:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076800/0x3e099f5ef04adfc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.308498:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076800/0x3e099f5ef04adfc3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.308505:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076800/0x3e099f5ef04adfc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.308511:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076800 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760682.308515:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076800/0x3e099f5ef04adfc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.308538:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076800/0x3e099f5ef04adfc3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.308552:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8df245dcca00) 00010000:00010000:2.0:1789760682.308555:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760682.308558:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076800/0x3e099f5ef04adfc3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.308563:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f076800/0x3e099f5ef04adfc3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760682.310903:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760682.311715:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863085952 00000100:00100000:1.0:1789760682.311727:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863085952 00000100:00100000:1.0:1789760682.311792:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:1.0:1789760682.311822:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+10:10447:x1876699863085952:12345-192.168.203.12@tcp:101:dd.500 00010000:00010000:1.0:1789760682.311847:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760682.311868:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04adfca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d0c3 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.311895:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000fac42dd/0x3e099f5ef04adf5a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d099 expref: 11 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.311903:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760682.311907:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760682.311912:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04adfca lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0c3 expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.311962:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000fac42dd/0x3e099f5ef04adf5a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d099 expref: 11 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.311976:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000fac42dd/0x3e099f5ef04adf5a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d099 expref: 11 pid: 6694 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760682.311988:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d716300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1876699883035136:192.168.203.12@tcp:104: 00000100:00100000:1.0:1789760682.312087:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df258f64e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789760682.317268:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760682.317486:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863086080 00000100:00100000:3.0:1789760682.317495:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863086080 00010000:00010000:3.0:1789760682.317539:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000fac42dd/0x3e099f5ef04adf5a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d099 expref: 12 pid: 6694 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760682.317607:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:1.0:1789760682.317613:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d716300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1876699883035136:192.168.203.12@tcp:104: 00000100:00100000:3.0:1789760682.317616:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1da0113a-370d-4d79-883c-54efc174697f+12:2349:x1876699863086080:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789760682.317629:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760682.317640:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04adfca lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0c3 expref: 12 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.317649:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000fac42dd/0x3e099f5ef04adf5a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d099 expref: 12 pid: 6694 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760682.317655:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df24f076e00, rc 0) 00010000:00010000:3.0:1789760682.317660:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000fac42dd/0x3e099f5ef04adf5a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d099 expref: 12 pid: 6694 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.317682:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fac42dd/0x3e099f5ef04adf5a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d099 expref: 12 pid: 6694 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760682.317695:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760682.317699:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760682.317706:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04adfca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0c3 expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760682.317713:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+11:10447:x1876699863085952:12345-192.168.203.12@tcp:101:dd.500 Request processed in 5913us (6820us total) trans 0 rc 0/0 00010000:00010000:3.0:1789760682.317716:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04adfca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0c3 expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760682.317721:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 32 00010000:00010000:3.0:1789760682.317748:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04adfca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0c3 expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760682.317763:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cae1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5830:1876699883035264:192.168.203.12@tcp:105: 00000100:00100000:3.0:1789760682.317858:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df27ce93b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789760682.322302:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760682.322569:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863086208 00000100:00100000:2.0:1789760682.322579:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863086208 00000100:00100000:0.0:1789760682.322610:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cae1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5830:1876699883035264:192.168.203.12@tcp:105: 00000100:00100000:2.0:1789760682.322634:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 33 00010000:00010000:0.0:1789760682.322639:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760682.322646:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+10:10447:x1876699863086208:12345-192.168.203.12@tcp:101:dd.500 00010000:00010000:2.0:1789760682.322662:0:8482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760682.322682:0:8482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098bab9ef/0x3e099f5ef04adfd1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d0ca expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.322712:0:8482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009832b5e8/0x3e099f5ef04adf61 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0a0 expref: 11 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.322722:0:8482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760682.322726:0:8482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760682.322732:0:8482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098bab9ef/0x3e099f5ef04adfd1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0ca expref: 11 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.322887:0:8482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009832b5e8/0x3e099f5ef04adf61 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0a0 expref: 11 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.322901:0:8482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009832b5e8/0x3e099f5ef04adf61 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0a0 expref: 11 pid: 6693 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760682.322916:0:8482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277cd8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8482:1876699883035392:192.168.203.12@tcp:104: 00000100:00100000:0.0:1789760682.323632:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1da0113a-370d-4d79-883c-54efc174697f+10:2349:x1876699863086080:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 6012us (6369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760682.323642:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:2.0:1789760682.325158:0:8482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df26d713780 going to sleep for 11 seconds 00000100:00100000:2.0:1789760682.333227:0:8482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277cd8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8482:1876699883035392:192.168.203.12@tcp:104: 00010000:00010000:2.0:1789760682.333265:0:8482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000098bab9ef/0x3e099f5ef04adfd1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0ca expref: 11 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760682.333284:0:8482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2779b9a00, rc 0) 00000100:00100000:2.0:1789760682.333352:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+11:10447:x1876699863086208:12345-192.168.203.12@tcp:101:dd.500 Request processed in 10709us (11060us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760682.333361:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:1.0:1789760682.333618:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760682.334955:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863086336 00000100:00100000:0.0:1789760682.334967:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863086336 00010000:00010000:0.0:1789760682.335063:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009832b5e8/0x3e099f5ef04adf61 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0a0 expref: 11 pid: 6693 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760682.335105:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:0.0:1789760682.335114:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d716300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1da0113a-370d-4d79-883c-54efc174697f+11:2349:x1876699863086336:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789760682.335128:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760682.335135:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009832b5e8/0x3e099f5ef04adf61 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0a0 expref: 11 pid: 6693 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.335146:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009832b5e8/0x3e099f5ef04adf61 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0a0 expref: 11 pid: 6693 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.335169:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009832b5e8/0x3e099f5ef04adf61 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0a0 expref: 11 pid: 6693 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.335186:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760682.335191:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760682.335298:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000098bab9ef/0x3e099f5ef04adfd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0ca expref: 10 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.335312:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098bab9ef/0x3e099f5ef04adfd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0ca expref: 10 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760682.335423:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000098bab9ef/0x3e099f5ef04adfd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0ca expref: 10 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760682.335452:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc46300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5829:1876699883035520:192.168.203.12@tcp:105: 00000100:00100000:0.0:1789760682.335546:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df24574d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760682.338785:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760682.338843:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760682.338927:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc46300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5829:1876699883035520:192.168.203.12@tcp:105: 00010000:00010000:0.0:1789760682.338948:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760682.339045:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863086464 00000100:00100000:3.0:1789760682.339052:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863086464 00002000:00010000:3.0:1789760682.339087:0:6698:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2 (0->18446744073709551615) 00002000:00100000:3.0:1789760682.339103:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df277cd8e00 with x1876699863086464 ext(0->18446744073709551615) 00002000:00010000:3.0:1789760682.339114:0:6698:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df277cd8e00. 00000100:00100000:3.0:1789760682.339134:0:6698:0:(nrs_tbf.c:1321:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 3 deadline 0 time 286452326371 state 0x0 ref 1 00000100:00100000:3.0:1789760682.339144:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 3 deadline 286652326371 time 286452326371 state 0x1 ref 1 00000100:00100000:3.0:1789760682.339164:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863086592 00000100:00100000:3.0:1789760682.339167:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863086592 00002000:00010000:3.0:1789760682.339181:0:6698:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1789760682.339184:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df277cd9c00 with x1876699863086592 ext(0->18446744073709551615) 00002000:00010000:3.0:1789760682.339190:0:6698:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df277cd9c00. 00000100:00100000:3.0:1789760682.339196:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 3 deadline 286652326371 time 286452326371 state 0x1 ref 2 00000100:00100000:3.0:1789760682.339221:0:6698:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 2 deadline 286652416454 time 286452416454 state 0x1 ref 2 00000100:00100000:3.0:1789760682.339232:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+10:2348:x1876699863086464:12345-192.168.203.12@tcp:10:dd.500 00002000:00010000:3.0:1789760682.339647:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789760682.339651:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 1789760681 -> 1789760681 00002000:00010000:3.0:1789760682.339654:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 1789760681 -> 1789760681 00002000:00010000:3.0:1789760682.339656:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 1789760681 -> 1789760681 00002000:00010000:3.0:1789760682.339658:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789760682.340006:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d716300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1da0113a-370d-4d79-883c-54efc174697f+11:2349:x1876699863086336:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 4890us (6386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760682.340015:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:3.0:1789760682.340137:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+11:2348:x1876699863086464:12345-192.168.203.12@tcp:10:dd.500 Request processed in 906us (1370us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789760682.340145:0:6698:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 0 00002000:00010000:3.0:1789760682.340149:0:6698:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2 (0->18446744073709551615) 00002000:00100000:3.0:1789760682.340152:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df277cd8e00 with x1876699863086464 ext(0->18446744073709551615) 00002000:00010000:3.0:1789760682.340157:0:6698:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df277cd8e00. 00000100:00100000:3.0:1789760682.340184:0:6698:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 1 deadline 286652416454 time 286453378829 state 0x0 ref 1 00000100:00100000:3.0:1789760682.340206:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+10:2348:x1876699863086592:12345-192.168.203.12@tcp:10:dd.500 00002000:00010000:3.0:1789760682.340531:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789760682.340534:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789760681 -> 1789760681 00002000:00010000:3.0:1789760682.340536:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789760681 -> 1789760681 00002000:00010000:3.0:1789760682.340538:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789760681 -> 1789760681 00002000:00010000:3.0:1789760682.340540:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789760682.340568:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+11:2348:x1876699863086592:12345-192.168.203.12@tcp:10:dd.500 Request processed in 375us (1725us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789760682.340575:0:6698:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:3.0:1789760682.340579:0:6698:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 1 deadline 286652416454 time 286453378829 state 0x2 ref 0 00002000:00010000:3.0:1789760682.340584:0:6698:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1789760682.340586:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df277cd9c00 with x1876699863086592 ext(0->18446744073709551615) 00002000:00010000:3.0:1789760682.340591:0:6698:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df277cd9c00. 00000100:00100000:1.0:1789760682.389684:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760682.395699:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863086720 00000100:00100000:3.0:1789760682.395713:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863086720 00002000:00100000:2.0:1789760682.402737:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->1048575) req@ffff8df2513df100 x1876699863086720/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:728/0 lens 488/0 e 0 to 0 dl 1789760693 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760682.402753:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df2513df100 with x1876699863086720 ext(0->1048575) 00002000:00010000:2.0:1789760682.402760:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df2513df100 00000100:00100000:2.0:1789760682.402785:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 1 deadline 286652416454 time 286453378829 state 0x0 ref 1 00000100:00100000:2.0:1789760682.402824:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 1 deadline 286653378829 time 286453378829 state 0x1 ref 1 00000100:00100000:2.0:1789760682.403548:0:6698:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 286653378829 time 286516727266 state 0x0 ref 1 00000100:00100000:2.0:1789760682.403567:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+11:2349:x1876699863086720:12345-192.168.203.12@tcp:4:dd.500 00000100:00100000:1.0:1789760682.423497:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760682.423654:0:6699:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789760682.423664:0:6699:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1789760682.424308:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863086848 00000100:00100000:2.0:1789760682.424320:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863086848 00002000:00100000:2.0:1789760682.424372:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2:0x0] (1048576->2097151) req@ffff8df258559500 x1876699863086848/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:728/0 lens 488/0 e 0 to 0 dl 1789760693 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760682.424383:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df258559500 with x1876699863086848 ext(1048576->2097151) 00002000:00010000:2.0:1789760682.424389:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df258559500 00000100:00100000:2.0:1789760682.424407:0:6699:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 286716727266 time 286516727266 state 0x1 ref 2 00000100:00100000:2.0:1789760682.463789:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+14:2349:x1876699863086720:12345-192.168.203.12@tcp:4:dd.500 Request processed in 60209us (74096us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789760682.463816:0:6698:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 2 00002000:00100000:2.0:1789760682.463830:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->1048575) req@ffff8df2513df100 x1876699863086720/t4294967304(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:728/0 lens 488/448 e 0 to 0 dl 1789760693 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760682.463840:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df2513df100 with x1876699863086720 ext(0->1048575) 00002000:00010000:2.0:1789760682.463847:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df2513df100 00000100:00100000:3.0:1789760682.473733:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760682.473837:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863086976 00000100:00100000:2.0:1789760682.473846:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863086976 00002000:00100000:2.0:1789760682.473896:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2:0x0] (2097152->3145727) req@ffff8df27cae1500 x1876699863086976/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:728/0 lens 488/0 e 0 to 0 dl 1789760693 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760682.473907:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cae1500 with x1876699863086976 ext(2097152->3145727) 00002000:00010000:2.0:1789760682.473927:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df27cae1500 00000100:00100000:2.0:1789760682.473943:0:6699:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 286716727266 time 286516727266 state 0x1 ref 2 00000100:00100000:1.0:1789760682.488176:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760682.488417:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863087104 00000100:00100000:3.0:1789760682.488428:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863087104 00002000:00100000:3.0:1789760682.488474:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (3145728->4194303) req@ffff8df274bc0000 x1876699863087104/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:728/0 lens 488/0 e 0 to 0 dl 1789760693 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789760682.488486:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df274bc0000 with x1876699863087104 ext(3145728->4194303) 00002000:00010000:3.0:1789760682.488491:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df274bc0000 00000100:00100000:3.0:1789760682.488514:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 286716727266 time 286516727266 state 0x1 ref 3 00000100:00100000:0.0:1789760682.518239:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760682.518392:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863087232 00000100:00100000:2.0:1789760682.518403:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863087232 00002000:00100000:2.0:1789760682.518449:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->1048575) req@ffff8df27cc46300 x1876699863087232/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:728/0 lens 488/0 e 0 to 0 dl 1789760693 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760682.518460:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cc46300 with x1876699863087232 ext(0->1048575) 00002000:00010000:2.0:1789760682.518465:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df27cc46300 00000100:00100000:2.0:1789760682.518480:0:6699:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 286716727266 time 286516727266 state 0x1 ref 4 00000100:00100000:3.0:1789760682.565157:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760682.567123:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863087360 00000100:00100000:2.0:1789760682.567137:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863087360 00002000:00100000:2.0:1789760682.567194:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (1048576->2097151) req@ffff8df27cae2300 x1876699863087360/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:728/0 lens 488/0 e 0 to 0 dl 1789760693 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760682.567216:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cae2300 with x1876699863087360 ext(1048576->2097151) 00002000:00010000:2.0:1789760682.567223:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df27cae2300 00000100:00100000:2.0:1789760682.567240:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 286716727266 time 286516727266 state 0x1 ref 5 00000100:00100000:2.0:1789760682.604007:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 286917192124 time 286717192124 state 0x1 ref 5 00000100:00100000:2.0:1789760682.604041:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258559500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+15:2350:x1876699863086848:12345-192.168.203.12@tcp:4:dd.500 00000100:00100000:1.0:1789760682.616684:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760682.616752:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760682.620514:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863087616 00000100:00100000:2.0:1789760682.620530:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863087616 00000100:00100000:2.0:1789760682.620637:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 101 00000100:00100000:2.0:1789760682.620648:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df274bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2349:x1876699863087616:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1789760682.620731:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df274bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2349:x1876699863087616:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 84us (4056us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760682.620753:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 101 00000100:00100000:0.0:1789760682.621482:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863087488 00000100:00100000:0.0:1789760682.621489:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863087488 00000100:00100000:0.0:1789760682.621532:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 251 00000100:00100000:0.0:1789760682.621540:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2349:x1876699863087488:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1789760682.621584:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2349:x1876699863087488:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 44us (4832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760682.621591:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 251 00000100:00080000:1.0:1789760682.621666:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760682.646665:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258559500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+17:2350:x1876699863086848:12345-192.168.203.12@tcp:4:dd.500 Request processed in 42631us (223169us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789760682.646691:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 3 00002000:00100000:0.0:1789760682.646706:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2:0x0] (1048576->2097151) req@ffff8df258559500 x1876699863086848/t4294967305(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:728/0 lens 488/448 e 0 to 0 dl 1789760693 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760682.646718:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df258559500 with x1876699863086848 ext(1048576->2097151) 00002000:00010000:0.0:1789760682.646724:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df258559500 00000100:00100000:3.0:1789760682.804163:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 287117348102 time 286917348102 state 0x1 ref 4 00000100:00100000:3.0:1789760682.804195:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+16:2351:x1876699863086976:12345-192.168.203.12@tcp:4:dd.500 00000100:00100000:2.0:1789760682.824370:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+18:2351:x1876699863086976:12345-192.168.203.12@tcp:4:dd.500 Request processed in 20180us (350636us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789760682.824384:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 4 00002000:00100000:2.0:1789760682.824397:0:11796:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2:0x0] (2097152->3145727) req@ffff8df27cae1500 x1876699863086976/t4294967306(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:728/0 lens 488/448 e 0 to 0 dl 1789760693 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760682.824407:0:11796:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cae1500 with x1876699863086976 ext(2097152->3145727) 00002000:00010000:2.0:1789760682.824412:0:11796:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df27cae1500 00000100:00100000:2.0:1789760683.005156:0:6698:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 287318340842 time 287118340842 state 0x1 ref 3 00000100:00100000:2.0:1789760683.005214:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df274bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+17:2348:x1876699863087104:12345-192.168.203.12@tcp:4:dd.500 00000100:00080000:1.0:1789760683.007864:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760683.026385:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df274bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+19:2348:x1876699863087104:12345-192.168.203.12@tcp:4:dd.500 Request processed in 21200us (538208us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789760683.026971:0:6698:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 5 00002000:00100000:2.0:1789760683.026992:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (3145728->4194303) req@ffff8df274bc0000 x1876699863087104/t4294967307(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:728/0 lens 488/448 e 0 to 0 dl 1789760693 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760683.027003:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df274bc0000 with x1876699863087104 ext(3145728->4194303) 00002000:00010000:2.0:1789760683.027009:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df274bc0000 00000100:00100000:3.0:1789760683.205644:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 287518827380 time 287318827380 state 0x1 ref 2 00000100:00100000:3.0:1789760683.205711:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+12:2349:x1876699863087232:12345-192.168.203.12@tcp:4:dd.500 00000100:00080000:1.0:1789760683.206837:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789760683.216407:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760683.224037:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+14:2349:x1876699863087232:12345-192.168.203.12@tcp:4:dd.500 Request processed in 18363us (705796us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789760683.224052:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 6 00002000:00100000:3.0:1789760683.224069:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->1048575) req@ffff8df27cc46300 x1876699863087232/t4294967306(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:728/0 lens 488/448 e 0 to 0 dl 1789760693 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789760683.224080:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cc46300 with x1876699863087232 ext(0->1048575) 00002000:00010000:3.0:1789760683.224086:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df27cc46300 00000100:00100000:2.0:1789760683.231414:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760683.231555:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863087744 00000100:00100000:0.0:1789760683.231580:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863087744 00002000:00100000:0.0:1789760683.231629:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (2097152->3145727) req@ffff8df277cdbb80 x1876699863087744/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/0 e 0 to 0 dl 1789760694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760683.231640:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df277cdbb80 with x1876699863087744 ext(2097152->3145727) 00002000:00010000:0.0:1789760683.231646:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df277cdbb80 00000100:00100000:0.0:1789760683.231661:0:6699:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 287518827380 time 287318827380 state 0x1 ref 2 00000100:00100000:0.0:1789760683.242892:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760683.243674:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863087872 00000100:00100000:2.0:1789760683.243685:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863087872 00002000:00100000:2.0:1789760683.243738:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (3145728->4194303) req@ffff8df27cc45c00 x1876699863087872/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/0 e 0 to 0 dl 1789760694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760683.243789:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cc45c00 with x1876699863087872 ext(3145728->4194303) 00002000:00010000:2.0:1789760683.243794:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df27cc45c00 00000100:00100000:2.0:1789760683.243844:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 287518827380 time 287318827380 state 0x1 ref 3 00000100:00100000:1.0:1789760683.251408:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760683.251733:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863088000 00000100:00100000:2.0:1789760683.251743:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863088000 00002000:00100000:2.0:1789760683.251845:0:11796:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2:0x0] (4194304->5242879) req@ffff8df274bc3b80 x1876699863088000/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/0 e 0 to 0 dl 1789760694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760683.251857:0:11796:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df274bc3b80 with x1876699863088000 ext(4194304->5242879) 00002000:00010000:2.0:1789760683.251871:0:11796:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df274bc3b80 00000100:00100000:2.0:1789760683.251888:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 287518827380 time 287318827380 state 0x1 ref 4 00000100:00100000:2.0:1789760683.276361:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760683.277079:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863088128 00000100:00100000:1.0:1789760683.277089:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863088128 00002000:00100000:1.0:1789760683.277135:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (5242880->6291455) req@ffff8df277cda300 x1876699863088128/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/0 e 0 to 0 dl 1789760694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789760683.277147:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df277cda300 with x1876699863088128 ext(5242880->6291455) 00002000:00010000:1.0:1789760683.277153:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df277cda300 00000100:00100000:1.0:1789760683.277166:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 287518827380 time 287318827380 state 0x1 ref 5 00000100:00100000:0.0:1789760683.302149:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760683.302455:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863088256 00000100:00100000:2.0:1789760683.302465:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863088256 00002000:00100000:2.0:1789760683.302511:0:11796:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2:0x0] (6291456->7340031) req@ffff8df27cc45500 x1876699863088256/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/0 e 0 to 0 dl 1789760694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760683.302522:0:11796:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cc45500 with x1876699863088256 ext(6291456->7340031) 00002000:00010000:2.0:1789760683.302528:0:11796:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df27cc45500 00000100:00100000:2.0:1789760683.302544:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 287518827380 time 287318827380 state 0x1 ref 6 00000100:00100000:1.0:1789760683.320382:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760683.320472:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863088384 00000100:00100000:3.0:1789760683.320479:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863088384 00002000:00100000:3.0:1789760683.320519:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (7340032->8388607) req@ffff8df274bc2300 x1876699863088384/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/0 e 0 to 0 dl 1789760694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789760683.320528:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df274bc2300 with x1876699863088384 ext(7340032->8388607) 00002000:00010000:3.0:1789760683.320532:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df274bc2300 00000100:00100000:3.0:1789760683.320544:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 287518827380 time 287318827380 state 0x1 ref 7 00000100:00100000:2.0:1789760683.405875:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 287719060139 time 287519060139 state 0x1 ref 7 00000100:00100000:2.0:1789760683.405913:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+15:2350:x1876699863087360:12345-192.168.203.12@tcp:4:dd.500 00000100:00100000:2.0:1789760683.417326:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+17:2350:x1876699863087360:12345-192.168.203.12@tcp:4:dd.500 Request processed in 11419us (852166us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789760683.417356:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 7 00002000:00100000:2.0:1789760683.417372:0:11796:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3:0x0] (1048576->2097151) req@ffff8df27cae2300 x1876699863087360/t4294967307(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:728/0 lens 488/448 e 0 to 0 dl 1789760693 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760683.417383:0:11796:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cae2300 with x1876699863087360 ext(1048576->2097151) 00002000:00010000:2.0:1789760683.417389:0:11796:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df27cae2300 00000100:00100000:1.0:1789760683.425978:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760683.426053:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863088512 00000100:00100000:0.0:1789760683.426063:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863088512 00002000:00100000:0.0:1789760683.426112:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (4194304->5242879) req@ffff8df274bc1c00 x1876699863088512/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/0 e 0 to 0 dl 1789760694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760683.426122:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df274bc1c00 with x1876699863088512 ext(4194304->5242879) 00002000:00010000:0.0:1789760683.426127:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df274bc1c00 00000100:00100000:0.0:1789760683.426142:0:6699:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 287719060139 time 287519060139 state 0x1 ref 7 00000100:00100000:3.0:1789760683.461893:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760683.462507:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863088640 00000100:00100000:1.0:1789760683.462519:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863088640 00002000:00100000:1.0:1789760683.462573:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (5242880->6291455) req@ffff8df27cae1f80 x1876699863088640/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/0 e 0 to 0 dl 1789760694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789760683.462585:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cae1f80 with x1876699863088640 ext(5242880->6291455) 00002000:00010000:1.0:1789760683.462591:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df27cae1f80 00000100:00100000:1.0:1789760683.462607:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 287719060139 time 287519060139 state 0x1 ref 8 00000100:00100000:0.0:1789760683.599309:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883035648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789760683.599378:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760683.599530:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883035648 00000100:00100000:2.0:1789760683.599537:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883035648 00000100:00100000:2.0:1789760683.599610:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789760683.599620:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883035648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789760683.599641:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 57868288 pending 6815744 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760683.599692:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883035648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760683.599699:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789760683.599750:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883035648:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789760683.599780:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760683.606491:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 287919676722 time 287719676722 state 0x1 ref 8 00000100:00100000:0.0:1789760683.606524:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+18:2351:x1876699863087744:12345-192.168.203.12@tcp:4:dd.500 00000100:00100000:2.0:1789760683.647023:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+20:2351:x1876699863087744:12345-192.168.203.12@tcp:4:dd.500 Request processed in 40504us (415608us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789760683.647037:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 8 00002000:00100000:2.0:1789760683.647052:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (2097152->3145727) req@ffff8df277cdbb80 x1876699863087744/t4294967308(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/448 e 0 to 0 dl 1789760694 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760683.647062:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df277cdbb80 with x1876699863087744 ext(2097152->3145727) 00002000:00010000:2.0:1789760683.647068:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df277cdbb80 00000100:00100000:0.0:1789760683.657855:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760683.659450:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863088768 00000100:00100000:3.0:1789760683.659464:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863088768 00002000:00100000:3.0:1789760683.659516:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (6291456->7340031) req@ffff8df27cc44a80 x1876699863088768/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/0 e 0 to 0 dl 1789760694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789760683.659528:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cc44a80 with x1876699863088768 ext(6291456->7340031) 00002000:00010000:3.0:1789760683.659534:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df27cc44a80 00000100:00100000:3.0:1789760683.659551:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 287919676722 time 287719676722 state 0x1 ref 8 00000100:00100000:1.0:1789760683.669313:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760683.669361:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760683.669456:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863089024 00000100:00100000:2.0:1789760683.669467:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863089024 00000100:00100000:2.0:1789760683.669541:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:2.0:1789760683.669552:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df274bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+17:10447:x1876699863089024:12345-192.168.203.12@tcp:35:dd.500 00000001:00080000:2.0:1789760683.669893:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967327 00000100:00100000:2.0:1789760683.670006:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df274bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+19:10447:x1876699863089024:12345-192.168.203.12@tcp:35:dd.500 Request processed in 454us (700us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1789760683.670013:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000020:00080000:2.0:1789760683.670018:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789760683.670034:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863089152 00000100:00100000:3.0:1789760683.670039:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863089152 00002000:00100000:3.0:1789760683.670070:0:11796:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3:0x0] (7340032->8388607) req@ffff8df274bc1180 x1876699863089152/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/0 e 0 to 0 dl 1789760694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00000100:00080000:1.0:1789760683.670076:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00100000:3.0:1789760683.670081:0:11796:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df274bc1180 with x1876699863089152 ext(7340032->8388607) 00002000:00010000:3.0:1789760683.670087:0:11796:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df274bc1180 00000100:00100000:3.0:1789760683.670099:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 287919676722 time 287719676722 state 0x1 ref 9 00000100:00100000:0.0:1789760683.739519:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760683.739622:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863089408 00000100:00100000:3.0:1789760683.739632:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863089408 00000100:00100000:3.0:1789760683.739696:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:3.0:1789760683.739707:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+19:10461:x1876699863089408:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1789760683.739731:0:7279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760683.739749:0:7279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675400/0x3e099f5ef04adfd8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d0d1 expref: -99 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.744709:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adfdf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.744732:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adfdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.744745:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adfdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.744843:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9200/0x3e099f5ef04adfe6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.744852:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9200/0x3e099f5ef04adfe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.744859:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9200/0x3e099f5ef04adfe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.745367:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9600/0x3e099f5ef04adfed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.745379:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9600/0x3e099f5ef04adfed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.745386:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9600/0x3e099f5ef04adfed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760683.745408:0:7279:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x6:0x0]: returning size 0 00010000:00010000:2.0:1789760683.745502:0:7279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adfdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.745510:0:7279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adfdf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.745516:0:7279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adfdf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.745523:0:7279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b8400 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760683.745527:0:7279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adfdf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.745535:0:7279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adfdf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.745547:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df250325c00) 00010000:00010000:2.0:1789760683.745550:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760683.745554:0:7279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adfdf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.745560:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04adfdf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.745571:0:7279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9200/0x3e099f5ef04adfe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.745577:0:7279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9200/0x3e099f5ef04adfe6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.745592:0:7279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9200/0x3e099f5ef04adfe6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.745598:0:7279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b9200 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760683.745600:0:7279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9200/0x3e099f5ef04adfe6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.745607:0:7279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9200/0x3e099f5ef04adfe6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.745615:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x572a2e26 (ffff8df250325b00) 00010000:00010000:2.0:1789760683.745617:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760683.745620:0:7279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9200/0x3e099f5ef04adfe6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.745626:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9200/0x3e099f5ef04adfe6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.745712:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675400/0x3e099f5ef04adfd8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0d1 expref: 22 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.745731:0:7279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9600/0x3e099f5ef04adfed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0d1 expref: 21 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.745739:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df245dcc700) 00010000:00010000:2.0:1789760683.745741:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789760683.745743:0:7279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2779b9600, rc 0) 00000100:00100000:2.0:1789760683.747981:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+21:10461:x1876699863089408:12345-192.168.203.12@tcp:101:dd.0 Request processed in 8266us (8460us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1789760683.748012:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:0.0:1789760683.758186:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760683.758378:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863089536 00000100:00100000:2.0:1789760683.758387:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863089536 00000100:00100000:2.0:1789760683.758499:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:2.0:1789760683.758511:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+22:10459:x1876699863089536:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1789760683.758530:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760683.758551:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011c8fdbd/0x3e099f5ef04adffb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d0d8 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.758584:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009893b0c0/0x3e099f5ef04adf8b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0ae expref: 23 pid: 8482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.758593:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789760683.758598:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760683.758604:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011c8fdbd/0x3e099f5ef04adffb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0d8 expref: 23 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.758648:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009893b0c0/0x3e099f5ef04adf8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0ae expref: 23 pid: 8482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.758664:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009893b0c0/0x3e099f5ef04adf8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0ae expref: 23 pid: 8482 timeout: 387 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760683.758678:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277cd9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6695:1876699883035776:192.168.203.12@tcp:104: 00000100:00100000:2.0:1789760683.758791:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df26d713300 going to sleep for 11 seconds 00000100:00100000:1.0:1789760683.769009:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760683.769049:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760683.769143:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863089792 00000100:00100000:3.0:1789760683.769153:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863089792 00000100:00100000:3.0:1789760683.769218:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:3.0:1789760683.769228:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df274bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+24:10462:x1876699863089792:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1789760683.769246:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760683.769262:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096f1774f/0x3e099f5ef04ae002 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d0df expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.769289:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760683.769294:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760683.769301:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096f1774f/0x3e099f5ef04ae002 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0df expref: 25 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.769314:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000096f1774f/0x3e099f5ef04ae002 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0df expref: 25 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.769327:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241674c00, rc 0) 00000100:00100000:3.0:1789760683.769375:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df274bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+25:10462:x1876699863089792:12345-192.168.203.12@tcp:101:dd.0 Request processed in 148us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760683.769382:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:0.0:1789760683.769573:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863089664 00000100:00100000:0.0:1789760683.769584:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863089664 00010000:00010000:0.0:1789760683.769605:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009893b0c0/0x3e099f5ef04adf8b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0ae expref: 25 pid: 8482 timeout: 387 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760683.769638:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:0.0:1789760683.769645:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df260392850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1da0113a-370d-4d79-883c-54efc174697f+25:2350:x1876699863089664:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789760683.769655:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760683.769675:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009893b0c0/0x3e099f5ef04adf8b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0ae expref: 25 pid: 8482 timeout: 387 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760683.769687:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009893b0c0/0x3e099f5ef04adf8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0ae expref: 25 pid: 8482 timeout: 387 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760683.769707:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760683.769710:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760683.769719:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000011c8fdbd/0x3e099f5ef04adffb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0d8 expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760683.769728:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011c8fdbd/0x3e099f5ef04adffb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0d8 expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760683.769736:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760683.769739:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760683.769744:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000096f1774f/0x3e099f5ef04ae002 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0df expref: 25 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760683.769752:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096f1774f/0x3e099f5ef04ae002 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0df expref: 25 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760683.769837:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000096f1774f/0x3e099f5ef04ae002 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0df expref: 25 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760683.769851:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc44e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5831:1876699883035904:192.168.203.12@tcp:105: 00010000:00010000:0.0:1789760683.769924:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000011c8fdbd/0x3e099f5ef04adffb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0d8 expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760683.769935:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc46a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5831:1876699883036032:192.168.203.12@tcp:105: 00000100:00100000:0.0:1789760683.769955:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df24574dcc0 going to sleep for 11 seconds 00010000:00010000:2.0:1789760683.770571:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009893b0c0/0x3e099f5ef04adf8b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0ae expref: 25 pid: 8482 timeout: 387 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760683.770590:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277cd9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6695:1876699883035776:192.168.203.12@tcp:104: 00010000:00010000:2.0:1789760683.770616:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000011c8fdbd/0x3e099f5ef04adffb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0d8 expref: 24 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.770628:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2779b9200, rc 0) 00000100:00100000:2.0:1789760683.770672:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+24:10459:x1876699863089536:12345-192.168.203.12@tcp:101:dd.0 Request processed in 12163us (12506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760683.770679:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:1.0:1789760683.771077:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760683.771211:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863089920 00000100:00100000:3.0:1789760683.771218:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863089920 00000100:00100000:3.0:1789760683.771265:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:3.0:1789760683.771273:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df274bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+23:10464:x1876699863089920:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1789760683.771287:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760683.771301:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae009 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d0e6 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.771323:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04adf92 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0b5 expref: 24 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.771340:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789760683.771344:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760683.771350:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae009 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0e6 expref: 24 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.771383:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04adf92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0b5 expref: 24 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.771397:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04adf92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0b5 expref: 24 pid: 6695 timeout: 387 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760683.771409:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c653480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1876699883036160:192.168.203.12@tcp:104: 00000100:00100000:3.0:1789760683.771470:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df27ce93d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789760683.772275:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760683.772343:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863090048 00000100:00100000:2.0:1789760683.772350:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863090048 00000100:00100000:2.0:1789760683.772391:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:2.0:1789760683.772400:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+24:10461:x1876699863090048:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1789760683.772411:0:8482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760683.772422:0:8482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da1a82bd/0x3e099f5ef04ae010 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d0ed expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.772442:0:8482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000011c8fdbd/0x3e099f5ef04adffb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0d8 expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.772450:0:8482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760683.772453:0:8482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789760683.772457:0:8482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da1a82bd/0x3e099f5ef04ae010 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0ed expref: 25 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.772498:0:8482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000011c8fdbd/0x3e099f5ef04adffb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0d8 expref: 25 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.772510:0:8482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000011c8fdbd/0x3e099f5ef04adffb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0d8 expref: 25 pid: 6695 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760683.772521:0:8482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277cd9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8482:1876699883036288:192.168.203.12@tcp:104: 00000100:00100000:2.0:1789760683.772576:0:8482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df26d713300 going to sleep for 11 seconds 00000100:00100000:3.0:1789760683.781876:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c653480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1876699883036160:192.168.203.12@tcp:104: 00010000:00010000:3.0:1789760683.781914:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae009 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0e6 expref: 24 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.781934:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241675a00, rc 0) 00000100:00100000:3.0:1789760683.782005:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df274bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+24:10464:x1876699863089920:12345-192.168.203.12@tcp:101:dd.0 Request processed in 10730us (10927us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760683.782015:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:2.0:1789760683.782033:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc44e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5831:1876699883035904:192.168.203.12@tcp:105: 00000100:00100000:2.0:1789760683.782043:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc46a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5831:1876699883036032:192.168.203.12@tcp:105: 00010000:00010000:2.0:1789760683.782056:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760683.782078:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df260392850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1da0113a-370d-4d79-883c-54efc174697f+25:2350:x1876699863089664:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 12434us (13029us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760683.782086:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:2.0:1789760683.782311:0:8482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277cd9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8482:1876699883036288:192.168.203.12@tcp:104: 00010000:00010000:2.0:1789760683.782331:0:8482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000da1a82bd/0x3e099f5ef04ae010 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0ed expref: 24 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.782344:0:8482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2779b8000, rc 0) 00000100:00100000:2.0:1789760683.790520:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+24:10461:x1876699863090048:12345-192.168.203.12@tcp:101:dd.0 Request processed in 18109us (18235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760683.790532:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:1.0:1789760683.793300:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760683.793453:0:7645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863090176 00000100:00100000:2.0:1789760683.793477:0:7645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863090176 00010000:00010000:2.0:1789760683.793518:0:7645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04adf92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0b5 expref: 24 pid: 6695 timeout: 387 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760683.794976:0:7645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:2.0:1789760683.794991:0:7645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df274bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1da0113a-370d-4d79-883c-54efc174697f+24:2351:x1876699863090176:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760683.795009:0:7645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760683.795034:0:7645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04adf92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0b5 expref: 24 pid: 6695 timeout: 387 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.795051:0:7645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04adf92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0b5 expref: 24 pid: 6695 timeout: 387 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.795075:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04adf92 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0b5 expref: 24 pid: 6695 timeout: 387 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.795093:0:7645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760683.795097:0:7645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760683.795115:0:7645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae009 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0e6 expref: 23 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.795126:0:7645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae009 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0e6 expref: 23 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.795165:0:7645:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae009 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0e6 expref: 23 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760683.795199:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277cd9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7645:1876699883036416:192.168.203.12@tcp:105: 00000100:00100000:2.0:1789760683.795293:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df26d713300 going to sleep for 11 seconds 00000100:00100000:3.0:1789760683.795499:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760683.795828:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863090304 00000100:00100000:1.0:1789760683.795835:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863090304 00000100:00100000:1.0:1789760683.795875:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:1.0:1789760683.795884:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+24:10460:x1876699863090304:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:1.0:1789760683.795898:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760683.795913:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088c40d55/0x3e099f5ef04ae017 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d0f4 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760683.795933:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789760683.795938:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1789760683.795943:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088c40d55/0x3e099f5ef04ae017 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0f4 expref: 25 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760683.795955:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000088c40d55/0x3e099f5ef04ae017 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0f4 expref: 25 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760683.795965:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df24f077600, rc 0) 00000100:00100000:1.0:1789760683.796011:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+25:10460:x1876699863090304:12345-192.168.203.12@tcp:101:dd.0 Request processed in 127us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760683.796018:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:2.0:1789760683.799744:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277cd9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7645:1876699883036416:192.168.203.12@tcp:105: 00010000:00010000:2.0:1789760683.799783:0:7645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760683.799867:0:7645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df274bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1da0113a-370d-4d79-883c-54efc174697f+23:2351:x1876699863090176:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 4880us (6577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760683.799878:0:7645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:3.0:1789760683.806626:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 288119811607 time 287919811607 state 0x1 ref 9 00000100:00100000:3.0:1789760683.806672:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+24:2350:x1876699863087872:12345-192.168.203.12@tcp:4:dd.500 00000100:00100000:3.0:1789760683.830987:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+26:2350:x1876699863087872:12345-192.168.203.12@tcp:4:dd.500 Request processed in 24316us (588092us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789760683.831002:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 9 00002000:00100000:3.0:1789760683.831014:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (3145728->4194303) req@ffff8df27cc45c00 x1876699863087872/t4294967309(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/448 e 0 to 0 dl 1789760694 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789760683.831024:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cc45c00 with x1876699863087872 ext(3145728->4194303) 00002000:00010000:3.0:1789760683.831030:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df27cc45c00 00000100:00100000:0.0:1789760683.847259:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760683.847324:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863090432 00000100:00100000:1.0:1789760683.847344:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863090432 00002000:00100000:1.0:1789760683.847406:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (1048576->2097151) req@ffff8df27cc47480 x1876699863090432/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/0 e 0 to 0 dl 1789760694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789760683.847417:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cc47480 with x1876699863090432 ext(1048576->2097151) 00002000:00010000:1.0:1789760683.847423:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df27cc47480 00000100:00100000:1.0:1789760683.847454:0:6698:0:(nrs_tbf.c:1321:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 3 deadline 0 time 287960646832 state 0x0 ref 1 00000100:00100000:1.0:1789760683.847472:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 3 deadline 287960746832 time 287960646832 state 0x1 ref 1 00000100:00100000:2.0:1789760683.847688:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 287960746832 time 287960881193 state 0x0 ref 1 00000100:00100000:2.0:1789760683.847713:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+23:2349:x1876699863090432:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:3.0:1789760683.852666:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760683.852768:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863090560 00000100:00100000:1.0:1789760683.852778:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863090560 00002000:00100000:1.0:1789760683.852863:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (3145728->4194303) req@ffff8df27c652300 x1876699863090560/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/0 e 0 to 0 dl 1789760694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789760683.852873:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27c652300 with x1876699863090560 ext(3145728->4194303) 00002000:00010000:1.0:1789760683.852880:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df27c652300 00000100:00100000:1.0:1789760683.852914:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 287960981193 time 287960881193 state 0x1 ref 2 00000100:00100000:1.0:1789760683.852943:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 287960981193 time 287966137413 state 0x0 ref 2 00000100:00100000:1.0:1789760683.852956:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c652300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+26:2348:x1876699863090560:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:3.0:1789760683.866922:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760683.868502:0:11796:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1789760683.868515:0:11796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1789760683.868931:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863090688 00000100:00100000:2.0:1789760683.868941:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863090688 00002000:00100000:2.0:1789760683.868995:0:11796:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x4:0x0] (0->1048575) req@ffff8df27c653b80 x1876699863090688/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/0 e 0 to 0 dl 1789760694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760683.869005:0:11796:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27c653b80 with x1876699863090688 ext(0->1048575) 00010000:00010000:2.0:1789760683.869014:0:11796:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000011c8fdbd/0x3e099f5ef04adffb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0d8 expref: 28 pid: 6695 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.869042:0:11796:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000011c8fdbd/0x3e099f5ef04adffb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0d8 expref: 28 pid: 6695 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760683.869050:0:11796:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8df27c653b80 00000100:00100000:2.0:1789760683.869076:0:11796:0:(nrs_tbf.c:1321:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff8df26d322e00 key uid={0} rule@0xffff8df258e6d100 gen 0 rate 10000 depth 3 token 3 deadline 0 time 287982268333 state 0x0 ref 1 00000100:00100000:2.0:1789760683.869087:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df26d322e00 key uid={0} rule@0xffff8df258e6d100 gen 0 rate 10000 depth 3 token 3 deadline 287982368333 time 287982268333 state 0x1 ref 1 00000100:00100000:2.0:1789760683.869360:0:11796:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1789760683.869373:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df26d322e00 key uid={0} rule@0xffff8df258e6d100 gen 0 rate 10000 depth 3 token 2 deadline 287982368333 time 287982568239 state 0x0 ref 1 00000100:00100000:2.0:1789760683.869385:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c653b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+28:2349:x1876699863090688:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:2.0:1789760683.871588:0:11797:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:2.0:1789760683.871600:0:11797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:1.0:1789760683.875679:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+25:2349:x1876699863090432:12345-192.168.203.12@tcp:4:dd.0 Request processed in 27959us (28420us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789760683.875693:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 18 00002000:00100000:1.0:1789760683.875707:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (1048576->2097151) req@ffff8df27cc47480 x1876699863090432/t4294967308(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/448 e 0 to 0 dl 1789760694 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789760683.875719:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cc47480 with x1876699863090432 ext(1048576->2097151) 00002000:00010000:1.0:1789760683.875725:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df27cc47480 00000100:00100000:2.0:1789760683.885098:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760683.885247:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863090816 00000100:00100000:0.0:1789760683.885258:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863090816 00002000:00100000:0.0:1789760683.885316:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (5242880->6291455) req@ffff8df277cd9f80 x1876699863090816/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/0 e 0 to 0 dl 1789760694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760683.885327:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df277cd9f80 with x1876699863090816 ext(5242880->6291455) 00002000:00010000:0.0:1789760683.885333:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df277cd9f80 00000100:00100000:0.0:1789760683.885377:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 287966237413 time 287966137413 state 0x1 ref 2 00000100:00100000:0.0:1789760683.885489:0:6698:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 287966237413 time 287998682900 state 0x0 ref 2 00000100:00100000:0.0:1789760683.885502:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+25:2348:x1876699863090816:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:2.0:1789760683.905889:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c652300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+30:2348:x1876699863090560:12345-192.168.203.12@tcp:4:dd.0 Request processed in 52926us (53223us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789760683.905904:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 19 00002000:00100000:2.0:1789760683.905918:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (3145728->4194303) req@ffff8df27c652300 x1876699863090560/t4294967310(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/448 e 0 to 0 dl 1789760694 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760683.905928:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27c652300 with x1876699863090560 ext(3145728->4194303) 00002000:00010000:2.0:1789760683.905934:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df27c652300 00000100:00100000:0.0:1789760683.931148:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760683.932155:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863090944 00000100:00100000:2.0:1789760683.932166:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863090944 00002000:00100000:2.0:1789760683.932256:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (7340032->8388607) req@ffff8df27cc45f80 x1876699863090944/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/0 e 0 to 0 dl 1789760694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760683.932267:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cc45f80 with x1876699863090944 ext(7340032->8388607) 00002000:00010000:2.0:1789760683.932273:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df27cc45f80 00000100:00100000:2.0:1789760683.932354:0:6699:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 287998782900 time 287998682900 state 0x1 ref 2 00000100:00100000:1.0:1789760683.933284:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760683.938719:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863091072 00000100:00100000:2.0:1789760683.938751:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863091072 00002000:00100000:2.0:1789760683.938829:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (6291456->7340031) req@ffff8df274bc0e00 x1876699863091072/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/0 e 0 to 0 dl 1789760694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760683.938839:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df274bc0e00 with x1876699863091072 ext(6291456->7340031) 00002000:00010000:2.0:1789760683.938844:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df274bc0e00 00000100:00100000:2.0:1789760683.938860:0:6699:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 287998782900 time 287998682900 state 0x1 ref 3 00000100:00100000:2.0:1789760683.938886:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 288052180266 time 288052080266 state 0x1 ref 3 00000100:00100000:2.0:1789760683.938897:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+28:2349:x1876699863090944:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:0.0:1789760683.942958:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 288052180266 time 288056144094 state 0x0 ref 3 00000100:00100000:0.0:1789760683.942984:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df274bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+29:2350:x1876699863091072:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:2.0:1789760683.943341:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c653b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+30:2349:x1876699863090688:12345-192.168.203.12@tcp:4:dd.0 Request processed in 73956us (76428us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789760683.943351:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:2.0:1789760683.943357:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df26d322e00 key uid={0} rule@0xffff8df258e6d100 gen 0 rate 10000 depth 3 token 2 deadline 287982368333 time 287982568239 state 0x2 ref 0 00002000:00100000:2.0:1789760683.943368:0:11796:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x4:0x0] (0->1048575) req@ffff8df27c653b80 x1876699863090688/t4294967311(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/448 e 0 to 0 dl 1789760694 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760683.943378:0:11796:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27c653b80 with x1876699863090688 ext(0->1048575) 00010000:00010000:2.0:1789760683.943388:0:11796:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000011c8fdbd/0x3e099f5ef04adffb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0d8 expref: 30 pid: 6695 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760683.943404:0:11796:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000011c8fdbd/0x3e099f5ef04adffb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0d8 expref: 30 pid: 6695 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760683.943412:0:11796:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8df27c653b80 00000100:00100000:2.0:1789760683.953138:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760683.953374:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760683.954287:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+31:2348:x1876699863090816:12345-192.168.203.12@tcp:4:dd.0 Request processed in 68782us (69192us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789760683.954299:0:6698:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 20 00002000:00100000:2.0:1789760683.954313:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (5242880->6291455) req@ffff8df277cd9f80 x1876699863090816/t4294967309(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/448 e 0 to 0 dl 1789760694 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760683.954323:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df277cd9f80 with x1876699863090816 ext(5242880->6291455) 00002000:00010000:2.0:1789760683.954328:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df277cd9f80 00000100:00100000:2.0:1789760683.954433:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863091200 00000100:00100000:2.0:1789760683.954441:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863091200 00002000:00100000:2.0:1789760683.954475:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (5242880->6291455) req@ffff8df277cdaa00 x1876699863091200/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/0 e 0 to 0 dl 1789760694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760683.954485:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df277cdaa00 with x1876699863091200 ext(5242880->6291455) 00002000:00010000:2.0:1789760683.954488:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df277cdaa00 00000100:00100000:2.0:1789760683.954525:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 288056244094 time 288056144094 state 0x1 ref 3 00000100:00100000:2.0:1789760683.954536:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863091328 00000100:00100000:2.0:1789760683.954539:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863091328 00002000:00100000:2.0:1789760683.954555:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (6291456->7340031) req@ffff8df2747bb480 x1876699863091328/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/0 e 0 to 0 dl 1789760694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760683.954564:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df2747bb480 with x1876699863091328 ext(6291456->7340031) 00002000:00010000:2.0:1789760683.954567:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df2747bb480 00000100:00100000:2.0:1789760683.954572:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 288056244094 time 288056144094 state 0x1 ref 4 00000100:00100000:2.0:1789760683.954585:0:6698:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 288067880922 time 288067780922 state 0x1 ref 4 00000100:00100000:2.0:1789760683.954596:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+31:2348:x1876699863091200:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:2.0:1789760683.954744:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 288067880922 time 288067937992 state 0x0 ref 4 00000100:00100000:2.0:1789760683.954754:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+32:2351:x1876699863091328:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:1.0:1789760683.961788:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760683.961846:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760683.961866:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760683.961901:0:11796:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 6 min 3 max 116 00000100:00100000:1.0:1789760683.961910:0:11796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_006' 00000100:00100000:3.0:1789760683.962015:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863091456 00000100:00100000:3.0:1789760683.962025:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863091456 00000100:00100000:1.0:1789760683.962037:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863091584 00000100:00100000:1.0:1789760683.962041:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863091584 00010000:00010000:3.0:1789760683.962071:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000011c8fdbd/0x3e099f5ef04adffb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0d8 expref: 34 pid: 6695 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1789760683.962076:0:11796:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x4:0x0] (4194304->5242879) req@ffff8df274bc2a00 x1876699863091584/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/0 e 0 to 0 dl 1789760694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789760683.962085:0:11796:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df274bc2a00 with x1876699863091584 ext(4194304->5242879) 00002000:00010000:1.0:1789760683.962090:0:11796:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df274bc2a00 00000100:00100000:3.0:1789760683.962103:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:1.0:1789760683.962105:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 288068037992 time 288067937992 state 0x1 ref 5 00000100:00100000:3.0:1789760683.962111:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df274bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1da0113a-370d-4d79-883c-54efc174697f+34:2348:x1876699863091456:12345-192.168.203.12@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789760683.962113:0:11796:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 6 min 3 max 116 00000100:00100000:1.0:1789760683.962118:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863091712 00000100:00100000:1.0:1789760683.962121:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863091712 00010000:00010000:3.0:1789760683.962124:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:1.0:1789760683.962132:0:11796:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x4:0x0] (7340032->8388607) req@ffff8df274bc3480 x1876699863091712/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/0 e 0 to 0 dl 1789760694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789760683.962138:0:11796:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df274bc3480 with x1876699863091712 ext(7340032->8388607) 00002000:00010000:3.0:1789760683.962140:0:5830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1789760683.962141:0:11796:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df274bc3480 00002000:00010000:3.0:1789760683.962143:0:5830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789760681 -> 1789760683 00002000:00010000:3.0:1789760683.962145:0:5830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789760681 -> 1789760683 00000100:00100000:1.0:1789760683.962146:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 288068037992 time 288067937992 state 0x1 ref 6 00010000:00010000:3.0:1789760683.962150:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000011c8fdbd/0x3e099f5ef04adffb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0d8 expref: 35 pid: 6695 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.962174:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000011c8fdbd/0x3e099f5ef04adffb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0d8 expref: 35 pid: 6695 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.962210:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011c8fdbd/0x3e099f5ef04adffb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0d8 expref: 35 pid: 6695 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.962223:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=1s v=(2 0) 00010000:00010000:3.0:1789760683.962227:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 2) 00010000:00010000:3.0:1789760683.962236:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000da1a82bd/0x3e099f5ef04ae010 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0ed expref: 34 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.962247:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da1a82bd/0x3e099f5ef04ae010 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0ed expref: 34 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.962256:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 2) 00010000:00010000:3.0:1789760683.962259:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 2) 00010000:00010000:3.0:1789760683.962264:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088c40d55/0x3e099f5ef04ae017 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0f4 expref: 34 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.962272:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088c40d55/0x3e099f5ef04ae017 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0f4 expref: 34 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760683.962308:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000088c40d55/0x3e099f5ef04ae017 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0f4 expref: 34 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760683.962336:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27c650e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5830:1876699883036544:192.168.203.12@tcp:105: 00010000:00010000:3.0:1789760683.962453:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000da1a82bd/0x3e099f5ef04ae010 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0ed expref: 34 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760683.962465:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d367b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5830:1876699883036672:192.168.203.12@tcp:105: 00000100:00100000:3.0:1789760683.962493:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df27ce933c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760683.962627:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 288075920876 time 288075820876 state 0x1 ref 6 00000100:00100000:1.0:1789760683.962639:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df274bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+34:2348:x1876699863091584:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:2.0:1789760683.974453:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760683.974486:0:11796:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 7 min 3 max 116 00000100:00100000:1.0:1789760683.974497:0:11796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_007' 00000100:00100000:2.0:1789760683.975590:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760683.975961:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+31:2349:x1876699863090944:12345-192.168.203.12@tcp:4:dd.0 Request processed in 37063us (44821us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789760683.976098:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 21 00002000:00100000:3.0:1789760683.976112:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (7340032->8388607) req@ffff8df27cc45f80 x1876699863090944/t4294967310(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/448 e 0 to 0 dl 1789760694 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760683.976122:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cc45f80 with x1876699863090944 ext(7340032->8388607) 00002000:00010000:3.0:1789760683.976129:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df27cc45f80 00000100:00100000:3.0:1789760683.976154:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863091840 00000100:00100000:3.0:1789760683.976161:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863091840 00002000:00100000:3.0:1789760683.976205:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (2097152->3145727) req@ffff8df27cae1c00 x1876699863091840/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/0 e 0 to 0 dl 1789760694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760683.976213:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cae1c00 with x1876699863091840 ext(2097152->3145727) 00002000:00010000:3.0:1789760683.976217:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df27cae1c00 00000100:00100000:3.0:1789760683.976230:0:6699:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 288075920876 time 288075820876 state 0x1 ref 6 00000100:00100000:3.0:1789760683.976241:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863091968 00000100:00100000:3.0:1789760683.976245:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863091968 00002000:00100000:3.0:1789760683.976277:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->1048575) req@ffff8df27cae1180 x1876699863091968/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/0 e 0 to 0 dl 1789760694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760683.976285:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cae1180 with x1876699863091968 ext(0->1048575) 00002000:00010000:3.0:1789760683.976288:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df27cae1180 00000100:00100000:2.0:1789760683.976294:0:11797:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 288089586053 time 288089486053 state 0x1 ref 6 00000100:00100000:2.0:1789760683.976309:0:11797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df274bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+36:2348:x1876699863091712:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:2.0:1789760683.977219:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27c650e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5830:1876699883036544:192.168.203.12@tcp:105: 00000100:00100000:1.0:1789760683.979557:0:11800:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 288089586053 time 288092744278 state 0x0 ref 7 00000100:00100000:1.0:1789760683.979643:0:11800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+32:2350:x1876699863091840:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:3.0:1789760683.979695:0:6699:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 288092844278 time 288092744278 state 0x1 ref 7 00000100:00100000:2.0:1789760683.986898:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d367b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5830:1876699883036672:192.168.203.12@tcp:105: 00010000:00010000:2.0:1789760683.986932:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760683.986979:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df274bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1da0113a-370d-4d79-883c-54efc174697f+37:2348:x1876699863091456:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 24867us (25131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760683.986990:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:0.0:1789760683.988632:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df274bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+34:2350:x1876699863091072:12345-192.168.203.12@tcp:4:dd.0 Request processed in 45649us (55344us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789760683.988645:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 22 00002000:00100000:0.0:1789760683.988657:0:11798:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3:0x0] (6291456->7340031) req@ffff8df274bc0e00 x1876699863091072/t4294967311(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/448 e 0 to 0 dl 1789760694 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760683.988668:0:11798:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df274bc0e00 with x1876699863091072 ext(6291456->7340031) 00002000:00010000:0.0:1789760683.988675:0:11798:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df274bc0e00 00000100:00100000:0.0:1789760683.988706:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 288092844278 time 288101897777 state 0x0 ref 6 00000100:00100000:0.0:1789760683.988719:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+33:2350:x1876699863091968:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:3.0:1789760683.999994:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+37:2348:x1876699863091200:12345-192.168.203.12@tcp:4:dd.0 Request processed in 45391us (46858us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789760684.000007:0:6698:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 23 00002000:00100000:3.0:1789760684.000020:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (5242880->6291455) req@ffff8df277cdaa00 x1876699863091200/t4294967312(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/448 e 0 to 0 dl 1789760694 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760684.000030:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df277cdaa00 with x1876699863091200 ext(5242880->6291455) 00002000:00010000:3.0:1789760684.000122:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df277cdaa00 00000100:00100000:1.0:1789760684.005904:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760684.005982:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760684.006001:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863092096 00000100:00100000:1.0:1789760684.006010:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863092096 00002000:00100000:1.0:1789760684.006060:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (3145728->4194303) req@ffff8df274bc1f80 x1876699863092096/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:730/0 lens 488/0 e 0 to 0 dl 1789760695 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789760684.006071:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df274bc1f80 with x1876699863092096 ext(3145728->4194303) 00002000:00010000:1.0:1789760684.006077:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df274bc1f80 00000100:00100000:1.0:1789760684.006121:0:6699:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 288101997777 time 288101897777 state 0x1 ref 6 00000100:00100000:1.0:1789760684.006134:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863092224 00000100:00100000:1.0:1789760684.006138:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863092224 00002000:00100000:1.0:1789760684.006154:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (4194304->5242879) req@ffff8df27cae0a80 x1876699863092224/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:730/0 lens 488/0 e 0 to 0 dl 1789760695 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789760684.006162:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cae0a80 with x1876699863092224 ext(4194304->5242879) 00002000:00010000:1.0:1789760684.006165:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df27cae0a80 00000100:00100000:1.0:1789760684.006171:0:6699:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 288101997777 time 288101897777 state 0x1 ref 7 00000100:00100000:1.0:1789760684.006183:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 288119478991 time 288119378991 state 0x1 ref 7 00000100:00100000:1.0:1789760684.006204:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df274bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+36:2348:x1876699863092096:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:2.0:1789760684.009274:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df274bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+37:2348:x1876699863091584:12345-192.168.203.12@tcp:4:dd.0 Request processed in 46626us (47484us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789760684.009288:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 25 00002000:00100000:2.0:1789760684.009302:0:11799:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x4:0x0] (4194304->5242879) req@ffff8df274bc2a00 x1876699863091584/t4294967313(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/448 e 0 to 0 dl 1789760694 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760684.009313:0:11799:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df274bc2a00 with x1876699863091584 ext(4194304->5242879) 00002000:00010000:2.0:1789760684.009320:0:11799:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df274bc2a00 00000100:00100000:2.0:1789760684.009353:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 288119478991 time 288122545939 state 0x0 ref 6 00000100:00100000:2.0:1789760684.009376:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+37:2348:x1876699863092224:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:2.0:1789760684.011751:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+37:2351:x1876699863091328:12345-192.168.203.12@tcp:4:dd.0 Request processed in 56988us (58367us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789760684.011776:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 24 00002000:00100000:2.0:1789760684.011787:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (6291456->7340031) req@ffff8df2747bb480 x1876699863091328/t4294967314(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/448 e 0 to 0 dl 1789760694 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760684.011797:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df2747bb480 with x1876699863091328 ext(6291456->7340031) 00002000:00010000:2.0:1789760684.011840:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df2747bb480 00000100:00100000:2.0:1789760684.011872:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 288325065078 time 288125065078 state 0x1 ref 8 00000100:00100000:2.0:1789760684.011887:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df274bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+38:2351:x1876699863088000:12345-192.168.203.12@tcp:4:dd.500 00000100:00100000:3.0:1789760684.014067:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760684.014149:0:6698:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 8 min 3 max 116 00000100:00100000:2.0:1789760684.014159:0:6698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_008' 00000100:00100000:0.0:1789760684.015692:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760684.015894:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760684.015922:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863092736 00000100:00100000:0.0:1789760684.015931:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863092736 00000100:00100000:0.0:1789760684.015987:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:0.0:1789760684.015997:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+21:10461:x1876699863092736:12345-192.168.203.12@tcp:35:dd.0 00000001:00080000:0.0:1789760684.016284:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967330 00000100:00100000:0.0:1789760684.016400:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+23:10461:x1876699863092736:12345-192.168.203.12@tcp:35:dd.0 Request processed in 403us (505us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1789760684.016409:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000020:00080000:0.0:1789760684.016602:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789760684.016782:0:11796:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 8 min 3 max 116 00000100:00100000:3.0:1789760684.016791:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863092352 00000100:00100000:3.0:1789760684.016796:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863092352 00002000:00100000:3.0:1789760684.016853:0:11796:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x4:0x0] (1048576->2097151) req@ffff8df26d366300 x1876699863092352/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:730/0 lens 488/0 e 0 to 0 dl 1789760695 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760684.016863:0:11796:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df26d366300 with x1876699863092352 ext(1048576->2097151) 00002000:00010000:3.0:1789760684.016869:0:11796:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df26d366300 00000100:00100000:3.0:1789760684.016885:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 288122645939 time 288122545939 state 0x1 ref 6 00000100:00100000:3.0:1789760684.016895:0:11796:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 8 min 3 max 116 00000100:00100000:3.0:1789760684.016902:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863092480 00000100:00100000:3.0:1789760684.016905:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863092480 00002000:00100000:3.0:1789760684.016919:0:11796:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x4:0x0] (2097152->3145727) req@ffff8df27cc46680 x1876699863092480/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:730/0 lens 488/0 e 0 to 0 dl 1789760695 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760684.016933:0:11796:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cc46680 with x1876699863092480 ext(2097152->3145727) 00002000:00010000:3.0:1789760684.016938:0:11796:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df27cc46680 00000100:00100000:3.0:1789760684.016945:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 288122645939 time 288122545939 state 0x1 ref 7 00000100:00100000:2.0:1789760684.017054:0:11797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df274bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+39:2348:x1876699863091712:12345-192.168.203.12@tcp:4:dd.0 Request processed in 40746us (55185us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789760684.017063:0:11797:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 26 00002000:00100000:2.0:1789760684.017070:0:11797:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x4:0x0] (7340032->8388607) req@ffff8df274bc3480 x1876699863091712/t4294967315(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/448 e 0 to 0 dl 1789760694 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760684.017078:0:11797:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df274bc3480 with x1876699863091712 ext(7340032->8388607) 00002000:00010000:2.0:1789760684.017082:0:11797:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df274bc3480 00000100:00100000:2.0:1789760684.017101:0:11797:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 288130395943 time 288130295943 state 0x1 ref 6 00000100:00100000:2.0:1789760684.017113:0:11797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d366300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+38:2351:x1876699863092352:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:0.0:1789760684.019889:0:11801:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 288130395943 time 288132993960 state 0x0 ref 6 00000100:00100000:0.0:1789760684.019927:0:11801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+39:2349:x1876699863092480:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:0.0:1789760684.024537:0:11800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+40:2350:x1876699863091840:12345-192.168.203.12@tcp:4:dd.0 Request processed in 44954us (50231us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789760684.024550:0:11800:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 27 00002000:00100000:0.0:1789760684.024562:0:11800:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3:0x0] (2097152->3145727) req@ffff8df27cae1c00 x1876699863091840/t4294967312(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/448 e 0 to 0 dl 1789760694 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760684.024573:0:11800:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cae1c00 with x1876699863091840 ext(2097152->3145727) 00002000:00010000:0.0:1789760684.024581:0:11800:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df27cae1c00 00000100:00100000:0.0:1789760684.030530:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+40:2350:x1876699863091968:12345-192.168.203.12@tcp:4:dd.0 Request processed in 41798us (54929us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789760684.030547:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 28 00002000:00100000:0.0:1789760684.030561:0:11798:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3:0x0] (0->1048575) req@ffff8df27cae1180 x1876699863091968/t4294967313(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/448 e 0 to 0 dl 1789760694 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760684.030571:0:11798:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cae1180 with x1876699863091968 ext(0->1048575) 00002000:00010000:0.0:1789760684.030578:0:11798:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df27cae1180 00000100:00100000:2.0:1789760684.033545:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df274bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+40:2348:x1876699863092096:12345-192.168.203.12@tcp:4:dd.0 Request processed in 27329us (27635us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789760684.033559:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 29 00002000:00100000:2.0:1789760684.033575:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (3145728->4194303) req@ffff8df274bc1f80 x1876699863092096/t4294967314(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:730/0 lens 488/448 e 0 to 0 dl 1789760695 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760684.033586:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df274bc1f80 with x1876699863092096 ext(3145728->4194303) 00002000:00010000:2.0:1789760684.033592:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df274bc1f80 00000100:00100000:2.0:1789760684.036210:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+40:2348:x1876699863092224:12345-192.168.203.12@tcp:4:dd.0 Request processed in 26829us (30219us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789760684.036223:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 30 00002000:00100000:2.0:1789760684.036235:0:11799:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3:0x0] (4194304->5242879) req@ffff8df27cae0a80 x1876699863092224/t4294967315(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:730/0 lens 488/448 e 0 to 0 dl 1789760695 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760684.036245:0:11799:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cae0a80 with x1876699863092224 ext(4194304->5242879) 00002000:00010000:2.0:1789760684.036251:0:11799:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df27cae0a80 00000100:00100000:2.0:1789760684.039942:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df274bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+40:2351:x1876699863088000:12345-192.168.203.12@tcp:4:dd.500 Request processed in 28048us (788535us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789760684.039957:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 10 00002000:00100000:2.0:1789760684.039971:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (4194304->5242879) req@ffff8df274bc3b80 x1876699863088000/t4294967316(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/448 e 0 to 0 dl 1789760694 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760684.039988:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df274bc3b80 with x1876699863088000 ext(4194304->5242879) 00002000:00010000:2.0:1789760684.039995:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df274bc3b80 00000100:00100000:2.0:1789760684.044553:0:11797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d366300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+41:2351:x1876699863092352:12345-192.168.203.12@tcp:4:dd.0 Request processed in 27430us (30484us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789760684.044584:0:11797:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 31 00002000:00100000:2.0:1789760684.044597:0:11797:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x4:0x0] (1048576->2097151) req@ffff8df26d366300 x1876699863092352/t4294967316(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:730/0 lens 488/448 e 0 to 0 dl 1789760695 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760684.044607:0:11797:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df26d366300 with x1876699863092352 ext(1048576->2097151) 00002000:00010000:2.0:1789760684.044613:0:11797:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df26d366300 00000100:00100000:2.0:1789760684.048846:0:11801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+41:2349:x1876699863092480:12345-192.168.203.12@tcp:4:dd.0 Request processed in 28886us (33119us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789760684.048860:0:11801:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:2.0:1789760684.048868:0:11801:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 288130395943 time 288132993960 state 0x2 ref 0 00002000:00100000:2.0:1789760684.048882:0:11801:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x4:0x0] (2097152->3145727) req@ffff8df27cc46680 x1876699863092480/t4294967317(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:730/0 lens 488/448 e 0 to 0 dl 1789760695 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760684.048892:0:11801:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cc46680 with x1876699863092480 ext(2097152->3145727) 00002000:00010000:2.0:1789760684.048899:0:11801:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df27cc46680 00000100:00100000:3.0:1789760684.212176:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 288525361684 time 288325361684 state 0x1 ref 7 00000100:00100000:3.0:1789760684.212210:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+39:2350:x1876699863088128:12345-192.168.203.12@tcp:4:dd.500 00010000:00010000:0.0:1789760684.238916:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760684.239125:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+41:2350:x1876699863088128:12345-192.168.203.12@tcp:4:dd.500 Request processed in 26924us (962767us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789760684.239137:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 11 00002000:00100000:2.0:1789760684.239150:0:11796:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2:0x0] (5242880->6291455) req@ffff8df277cda300 x1876699863088128/t4294967317(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/448 e 0 to 0 dl 1789760694 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760684.239161:0:11796:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df277cda300 with x1876699863088128 ext(5242880->6291455) 00002000:00010000:2.0:1789760684.239167:0:11796:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df277cda300 00000100:00100000:2.0:1789760684.413914:0:6698:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 288727100299 time 288527100299 state 0x1 ref 6 00000100:00100000:2.0:1789760684.413942:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+40:2350:x1876699863088256:12345-192.168.203.12@tcp:4:dd.500 00000100:00100000:2.0:1789760684.431009:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+42:2350:x1876699863088256:12345-192.168.203.12@tcp:4:dd.500 Request processed in 17069us (1128858us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789760684.431031:0:6698:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 12 00002000:00100000:2.0:1789760684.431044:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (6291456->7340031) req@ffff8df27cc45500 x1876699863088256/t4294967318(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/448 e 0 to 0 dl 1789760694 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760684.431054:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cc45500 with x1876699863088256 ext(6291456->7340031) 00002000:00010000:2.0:1789760684.431068:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df27cc45500 00000100:00100000:0.0:1789760684.614069:0:11800:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 288927253909 time 288727253909 state 0x1 ref 5 00000100:00100000:0.0:1789760684.614103:0:11800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df274bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+41:2350:x1876699863088384:12345-192.168.203.12@tcp:4:dd.500 00000100:00100000:0.0:1789760684.633275:0:11800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df274bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+43:2350:x1876699863088384:12345-192.168.203.12@tcp:4:dd.500 Request processed in 19178us (1312889us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1789760684.633289:0:11800:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 13 00002000:00100000:0.0:1789760684.633303:0:11800:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x2:0x0] (7340032->8388607) req@ffff8df274bc2300 x1876699863088384/t4294967319(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/448 e 0 to 0 dl 1789760694 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760684.633326:0:11800:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df274bc2300 with x1876699863088384 ext(7340032->8388607) 00002000:00010000:0.0:1789760684.633332:0:11800:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df274bc2300 00000100:00100000:0.0:1789760684.819148:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 289132334457 time 288932334457 state 0x1 ref 4 00000100:00100000:0.0:1789760684.819180:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df274bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+40:2348:x1876699863088512:12345-192.168.203.12@tcp:4:dd.500 00000100:00100000:0.0:1789760684.834982:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df274bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+42:2348:x1876699863088512:12345-192.168.203.12@tcp:4:dd.500 Request processed in 15805us (1409000us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1789760684.834996:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 14 00002000:00100000:0.0:1789760684.835010:0:11798:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3:0x0] (4194304->5242879) req@ffff8df274bc1c00 x1876699863088512/t4294967318(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/448 e 0 to 0 dl 1789760694 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760684.835020:0:11798:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df274bc1c00 with x1876699863088512 ext(4194304->5242879) 00002000:00010000:0.0:1789760684.835027:0:11798:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df274bc1c00 00000100:00100000:2.0:1789760685.019334:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 289332520530 time 289132520530 state 0x1 ref 3 00000100:00100000:2.0:1789760685.019385:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+41:2350:x1876699863088640:12345-192.168.203.12@tcp:4:dd.500 00000100:00080000:1.0:1789760685.019632:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789760685.030918:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+43:2350:x1876699863088640:12345-192.168.203.12@tcp:4:dd.500 Request processed in 11555us (1569024us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1789760685.030932:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 15 00002000:00100000:3.0:1789760685.030943:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (5242880->6291455) req@ffff8df27cae1f80 x1876699863088640/t4294967319(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/448 e 0 to 0 dl 1789760694 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789760685.030954:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cae1f80 with x1876699863088640 ext(5242880->6291455) 00002000:00010000:3.0:1789760685.030960:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df27cae1f80 00000100:00100000:0.0:1789760685.135114:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789760685.136005:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1876699883037056:0@lo:400:kworker.0 00000100:00100000:1.0:1789760685.136077:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760685.136135:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789760685.136141:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d365500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883036928:0@lo:400:kworker.0 00000100:00100000:1.0:1789760685.136163:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760685.138467:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883037056 00000100:00100000:2.0:1789760685.138482:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883037056 00000100:00100000:2.0:1789760685.138554:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883036928 00000100:00100000:2.0:1789760685.138558:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883036928 00000100:00100000:2.0:1789760685.138584:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789760685.138594:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df274bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876699883037056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760685.138676:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df274bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876699883037056:12345-0@lo:400:kworker.0 Request processed in 83us (2598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760685.138682:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789760685.138700:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789760685.138706:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df274bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883036928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760685.138736:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df274bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883036928:12345-0@lo:400:kworker.0 Request processed in 30us (2572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760685.138742:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789760685.138797:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d365500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883036928:0@lo:400:kworker.0 00000100:00100000:2.0:1789760685.138871:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1876699883037056:0@lo:400:kworker.0 00000100:00080000:1.0:1789760685.139092:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760685.141577:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883037184:0@lo:400:kworker.0 00000100:00100000:0.0:1789760685.141650:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760685.141697:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699883036800:0@lo:400:kworker.0 00000100:00100000:0.0:1789760685.141722:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760685.141852:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883037184 00000100:00100000:1.0:1789760685.141872:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883037184 00000100:00100000:1.0:1789760685.141930:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789760685.141939:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883037184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760685.141991:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883037184:12345-0@lo:400:kworker.0 Request processed in 54us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760685.141998:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1789760685.142122:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760685.142152:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883037184:0@lo:400:kworker.0 00000100:00100000:2.0:1789760685.142215:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883036800 00000100:00100000:2.0:1789760685.142220:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883036800 00000100:00100000:2.0:1789760685.142256:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789760685.142263:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258609050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3308:x1876699883036800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760685.142440:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258609050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3308:x1876699883036800:12345-0@lo:400:kworker.0 Request processed in 176us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760685.142447:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789760685.144361:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789760685.144380:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883037440:0@lo:400:kworker.0 00000100:00100000:3.0:1789760685.144443:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760685.144560:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1876699883037312:0@lo:400:kworker.0 00000100:00100000:0.0:1789760685.144592:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760685.144673:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883037312 00000100:00100000:2.0:1789760685.144680:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883037312 00000100:00100000:2.0:1789760685.144743:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789760685.144770:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876699883037312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760685.144854:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876699883037312:12345-0@lo:400:kworker.0 Request processed in 86us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760685.144861:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:0.0:1789760685.145002:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760685.145031:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1876699883037312:0@lo:400:kworker.0 00000100:00100000:0.0:1789760685.145166:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883037440 00000100:00100000:0.0:1789760685.145171:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883037440 00000100:00100000:0.0:1789760685.145218:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789760685.145225:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d364e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1876699883037440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760685.145266:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d364e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1876699883037440:12345-0@lo:400:kworker.0 Request processed in 43us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760685.145272:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789760685.145299:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883037440:0@lo:400:kworker.0 00000100:00080000:2.0:1789760685.145427:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789760685.148056:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699883036800:0@lo:400:kworker.0 00000100:00100000:2.0:1789760685.219697:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 289532882049 time 289332882049 state 0x1 ref 2 00000100:00100000:2.0:1789760685.219731:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+42:2348:x1876699863088768:12345-192.168.203.12@tcp:4:dd.500 00000100:00100000:3.0:1789760685.260311:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+44:2348:x1876699863088768:12345-192.168.203.12@tcp:4:dd.500 Request processed in 40588us (1602457us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1789760685.260325:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 16 00002000:00100000:3.0:1789760685.260337:0:11799:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3:0x0] (6291456->7340031) req@ffff8df27cc44a80 x1876699863088768/t4294967320(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/448 e 0 to 0 dl 1789760694 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789760685.260347:0:11799:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cc44a80 with x1876699863088768 ext(6291456->7340031) 00002000:00010000:3.0:1789760685.260362:0:11799:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df27cc44a80 00010000:00010000:3.0:1789760685.263167:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760685.421310:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 289532882049 time 289534497347 state 0x0 ref 1 00000100:00100000:2.0:1789760685.421341:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df274bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+43:2348:x1876699863089152:12345-192.168.203.12@tcp:4:dd.500 00000100:00100000:0.0:1789760685.442554:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df274bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+45:2348:x1876699863089152:12345-192.168.203.12@tcp:4:dd.500 Request processed in 21217us (1773182us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1789760685.442568:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:0.0:1789760685.442575:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 289532882049 time 289534497347 state 0x2 ref 0 00002000:00100000:0.0:1789760685.442592:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (7340032->8388607) req@ffff8df274bc1180 x1876699863089152/t4294967321(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:729/0 lens 488/448 e 0 to 0 dl 1789760694 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760685.442602:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df274bc1180 with x1876699863089152 ext(7340032->8388607) 00002000:00010000:0.0:1789760685.442608:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df274bc1180 00000100:00100000:2.0:1789760685.484851:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760685.484889:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760685.485033:0:7645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863092864 00000100:00100000:3.0:1789760685.485043:0:7645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863092864 00000100:00100000:3.0:1789760685.485100:0:7645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863092992 00000100:00100000:3.0:1789760685.485103:0:7645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863092992 00000100:00100000:3.0:1789760685.485147:0:7645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:3.0:1789760685.485157:0:7645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c650e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1da0113a-370d-4d79-883c-54efc174697f+45:5586:x1876699863092864:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789760685.485171:0:7645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00002000:00010000:3.0:1789760685.485189:0:7645:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:3.0:1789760685.485193:0:7645:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789760681 -> 1789760683 00002000:00010000:3.0:1789760685.485196:0:7645:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789760681 -> 1789760683 00010000:00010000:3.0:1789760685.485229:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098bab9ef/0x3e099f5ef04adfd1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0ca expref: 45 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760685.485261:0:7645:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 4194304 -> 8388608 00010000:00010000:3.0:1789760685.485272:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da1a82bd/0x3e099f5ef04ae010 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0ed expref: 44 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.485285:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088c40d55/0x3e099f5ef04ae017 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0f4 expref: 43 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.485298:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096f1774f/0x3e099f5ef04ae002 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0df expref: 42 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.485323:0:7645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760685.485373:0:7645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c650e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1da0113a-370d-4d79-883c-54efc174697f+41:5586:x1876699863092864:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 216us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760685.485394:0:7645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:3.0:1789760685.485413:0:7645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:3.0:1789760685.485420:0:7645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d716300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1da0113a-370d-4d79-883c-54efc174697f+43:5585:x1876699863092992:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789760685.485429:0:7645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00002000:00010000:3.0:1789760685.485440:0:7645:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:3.0:1789760685.485443:0:7645:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 1789760681 -> 1789760682 00002000:00010000:3.0:1789760685.485445:0:7645:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 1789760681 -> 1789760682 00010000:00010000:3.0:1789760685.485456:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04adfca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0c3 expref: 43 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760685.485479:0:7645:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:3.0:1789760685.485482:0:7645:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789760681 -> 1789760683 00002000:00010000:3.0:1789760685.485484:0:7645:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789760681 -> 1789760683 00010000:00010000:3.0:1789760685.485491:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae009 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0e6 expref: 42 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.485505:0:7645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760685.485525:0:7645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d716300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1da0113a-370d-4d79-883c-54efc174697f+41:5585:x1876699863092992:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 106us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760685.485532:0:7645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00080000:1.0:1789760685.486045:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760685.570110:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760685.570322:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863093248 00000100:00100000:0.0:1789760685.570332:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863093248 00000100:00100000:0.0:1789760685.570406:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:0.0:1789760685.570416:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+23:10495:x1876699863093248:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:0.0:1789760685.570439:0:7279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760685.570461:0:7279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67000/0x3e099f5ef04ae01e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d0fb expref: -99 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.570534:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ae025 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.570554:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ae025 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.570565:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ae025 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.570580:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66200/0x3e099f5ef04ae02c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.570587:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66200/0x3e099f5ef04ae02c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.570594:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66200/0x3e099f5ef04ae02c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.570943:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ae033 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.570953:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ae033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.570961:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ae033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760685.570971:0:7279:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 16777216 00010000:00010000:0.0:1789760685.571053:0:7279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ae025 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.571061:0:7279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ae025 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.571067:0:7279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ae025 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.571079:0:7279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67200 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760685.571083:0:7279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ae025 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.571091:0:7279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ae025 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.571103:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df250325c00) 00010000:00010000:0.0:1789760685.571106:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760685.571110:0:7279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ae025 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.571115:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ae025 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.571128:0:7279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66200/0x3e099f5ef04ae02c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.571134:0:7279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66200/0x3e099f5ef04ae02c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.571140:0:7279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66200/0x3e099f5ef04ae02c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.571144:0:7279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66200 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760685.571147:0:7279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66200/0x3e099f5ef04ae02c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.571153:0:7279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66200/0x3e099f5ef04ae02c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.571171:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xe7cddcd6 (ffff8df2502f3a00) 00010000:00010000:0.0:1789760685.571174:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760685.571177:0:7279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66200/0x3e099f5ef04ae02c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.571183:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66200/0x3e099f5ef04ae02c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.571224:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67000/0x3e099f5ef04ae01e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0fb expref: 26 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.571238:0:7279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ae033 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0fb expref: 25 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.571246:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8df245dcca00) 00010000:00010000:0.0:1789760685.571249:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789760685.571251:0:7279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df243a66e00, rc 0) 00000100:00080000:1.0:1789760685.571383:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760685.571425:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+25:10495:x1876699863093248:12345-192.168.203.12@tcp:101:dd.0 Request processed in 1009us (1323us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1789760685.571433:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:1.0:1789760685.585890:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760685.586010:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760685.586102:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863093376 00000100:00100000:3.0:1789760685.586114:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863093376 00000100:00100000:3.0:1789760685.586224:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863093504 00000100:00100000:3.0:1789760685.586228:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863093504 00000100:00100000:3.0:1789760685.586263:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:3.0:1789760685.586273:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df274bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+42:10498:x1876699863093376:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1789760685.586299:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760685.586318:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae041 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d109 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760685.586345:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 8388608, mtime: 0x6aad94aa, atime: 0x6aad94a9, ctime: 0x6aad94aa, blocks: 0x1 00010000:00010000:3.0:1789760685.586366:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=289s v=(0 0) 00010000:00010000:3.0:1789760685.586371:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760685.586381:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae041 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d109 expref: 43 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.586397:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae041 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d109 expref: 43 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.586410:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241675a00, rc 0) 00000100:00100000:3.0:1789760685.586467:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df274bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+43:10498:x1876699863093376:12345-192.168.203.12@tcp:101:dd.0 Request processed in 196us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760685.586474:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:3.0:1789760685.586494:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:3.0:1789760685.586501:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+42:10495:x1876699863093504:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1789760685.586508:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760685.586516:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096f1774f/0x3e099f5ef04ae048 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d102 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.586529:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760685.586532:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760685.586538:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096f1774f/0x3e099f5ef04ae048 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d102 expref: 43 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.586557:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000096f1774f/0x3e099f5ef04ae048 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d102 expref: 43 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.586566:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241674c00, rc 0) 00000100:00100000:3.0:1789760685.586587:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+43:10495:x1876699863093504:12345-192.168.203.12@tcp:101:dd.0 Request processed in 88us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760685.586593:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:2.0:1789760685.593048:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760685.593091:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760685.593171:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760685.596706:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760685.596965:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863093632 00000100:00100000:0.0:1789760685.596975:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863093632 00000100:00100000:0.0:1789760685.597030:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863093760 00000100:00100000:0.0:1789760685.597033:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863093760 00000100:00100000:0.0:1789760685.597044:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863093888 00000100:00100000:0.0:1789760685.597047:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863093888 00000100:00100000:0.0:1789760685.597061:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:0.0:1789760685.597069:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+45:10501:x1876699863093632:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:0.0:1789760685.597099:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760685.597115:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae04f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d110 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.597142:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760685.597147:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760685.597156:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae04f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d110 expref: 46 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760685.597266:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:1.0:1789760685.597277:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d063050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+46:10497:x1876699863093760:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:1.0:1789760685.597285:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760685.597293:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae056 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d117 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.597307:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760685.597310:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760685.597316:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae056 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d117 expref: 47 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.597329:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae056 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d117 expref: 47 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.597343:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df24f076200, rc 0) 00000100:00100000:1.0:1789760685.597410:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d063050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+47:10497:x1876699863093760:12345-192.168.203.12@tcp:101:dd.0 Request processed in 135us (4318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760685.597417:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:1.0:1789760685.597437:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:1.0:1789760685.597444:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+46:10496:x1876699863093888:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:1.0:1789760685.597450:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760685.597457:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae05d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d11e expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.597468:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760685.597471:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760685.597476:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae05d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d11e expref: 47 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.597485:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae05d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d11e expref: 47 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.597494:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df24f076400, rc 0) 00000100:00100000:1.0:1789760685.597513:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+47:10496:x1876699863093888:12345-192.168.203.12@tcp:101:dd.0 Request processed in 70us (4342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760685.597519:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00010000:00010000:0.0:1789760685.597690:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae04f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d110 expref: 46 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.597702:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df243a67000, rc 0) 00000100:00100000:0.0:1789760685.597740:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+46:10501:x1876699863093632:12345-192.168.203.12@tcp:101:dd.0 Request processed in 671us (4700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760685.597756:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:3.0:1789760685.600080:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863094016 00000100:00100000:3.0:1789760685.600092:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863094016 00000100:00100000:3.0:1789760685.600486:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:3.0:1789760685.600498:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+46:10505:x1876699863094016:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1789760685.600515:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760685.600532:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae064 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d125 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.600558:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760685.600562:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760685.600570:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae064 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d125 expref: 47 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.600585:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae064 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d125 expref: 47 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.600597:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241674000, rc 0) 00000100:00100000:3.0:1789760685.600735:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+47:10505:x1876699863094016:12345-192.168.203.12@tcp:101:dd.0 Request processed in 238us (4036us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760685.600792:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:1.0:1789760685.607080:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760685.607159:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760685.607246:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863094144 00000100:00100000:0.0:1789760685.607256:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863094144 00000100:00100000:0.0:1789760685.607311:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:0.0:1789760685.607321:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+47:10504:x1876699863094144:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:0.0:1789760685.607340:0:8482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760685.607381:0:8482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae06b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d12c expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.607410:0:8482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760685.607414:0:8482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760685.607438:0:8482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae06b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d12c expref: 48 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.607455:0:8482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae06b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d12c expref: 48 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.607469:0:8482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df243a66200, rc 0) 00000100:00100000:0.0:1789760685.607519:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+48:10504:x1876699863094144:12345-192.168.203.12@tcp:101:dd.0 Request processed in 199us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760685.607526:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:2.0:1789760685.607776:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863094272 00000100:00100000:2.0:1789760685.607780:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863094272 00002000:00100000:2.0:1789760685.607843:0:11797:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2:0x0] (0->1048575) req@ffff8df144667480 x1876699863094272/t0(0) o3->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:731/0 lens 488/0 e 0 to 0 dl 1789760696 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760685.607853:0:11797:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df144667480 with x1876699863094272 ext(0->1048575) 00002000:00010000:2.0:1789760685.607858:0:11797:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df144667480 00000100:00100000:2.0:1789760685.607870:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 288130395943 time 288132993960 state 0x0 ref 1 00000100:00100000:2.0:1789760685.607880:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 288133093960 time 288132993960 state 0x1 ref 1 00000100:00100000:2.0:1789760685.607904:0:11797:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 288133093960 time 289721099093 state 0x0 ref 1 00000100:00100000:2.0:1789760685.607914:0:11797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+48:2351:x1876699863094272:12345-192.168.203.12@tcp:3:dd.0 00000100:00100000:0.0:1789760685.634839:0:11797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+48:2351:x1876699863094272:12345-192.168.203.12@tcp:3:dd.0 Request processed in 26877us (27718us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760685.634854:0:11797:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:0.0:1789760685.634862:0:11797:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 288133093960 time 289721099093 state 0x2 ref 0 00002000:00100000:0.0:1789760685.634879:0:11797:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x2:0x0] (0->1048575) req@ffff8df144667480 x1876699863094272/t0(0) o3->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:731/0 lens 488/440 e 0 to 0 dl 1789760696 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760685.634890:0:11797:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df144667480 with x1876699863094272 ext(0->1048575) 00002000:00010000:0.0:1789760685.634896:0:11797:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df144667480 00000100:00100000:3.0:1789760685.648430:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df144666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883037568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760685.648514:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760685.648723:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883037568 00000100:00100000:1.0:1789760685.648732:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883037568 00000100:00100000:1.0:1789760685.648824:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789760685.648835:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d366a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876699883037568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789760685.648870:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 98762752 pending 27262976 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760685.648920:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d366a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876699883037568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760685.648928:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789760685.650684:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df144666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883037568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760685.716071:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760685.716268:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863094528 00000100:00100000:0.0:1789760685.716288:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863094528 00000100:00100000:0.0:1789760685.716348:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:0.0:1789760685.716359:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+25:10506:x1876699863094528:12345-192.168.203.12@tcp:35:dd.0 00000100:00100000:0.0:1789760685.716597:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+26:10506:x1876699863094528:12345-192.168.203.12@tcp:35:dd.0 Request processed in 239us (534us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1789760685.716606:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:2.0:1789760685.759562:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760685.759785:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863094656 00000100:00100000:0.0:1789760685.759796:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863094656 00000100:00100000:0.0:1789760685.759881:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:0.0:1789760685.759892:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+26:10511:x1876699863094656:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:0.0:1789760685.759915:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760685.759935:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04ae072 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d133 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.760001:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04ae079 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.760014:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04ae079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.760025:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04ae079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760685.760070:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789760685.760073:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789760685.760090:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04ae079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.760115:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04ae072 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d133 expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.760134:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04ae079 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d133 expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.760142:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df250325c00) 00010000:00010000:0.0:1789760685.760145:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789760685.760160:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df243a66a00, rc 0) 00000100:00100000:0.0:1789760685.760287:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+27:10511:x1876699863094656:12345-192.168.203.12@tcp:101:rm.0 Request processed in 396us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760685.760295:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:1.0:1789760685.768443:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760685.768537:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863094912 00000100:00100000:2.0:1789760685.768548:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863094912 00000100:00100000:2.0:1789760685.768608:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:2.0:1789760685.768618:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+27:10511:x1876699863094912:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:2.0:1789760685.768636:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760685.768656:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8a00/0x3e099f5ef04ae080 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d13a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760685.768775:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789760685.768908:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8a00/0x3e099f5ef04ae080 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d13a expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.768924:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df250325700) 00010000:00010000:2.0:1789760685.768927:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789760685.768932:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8a00/0x3e099f5ef04ae080 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d13a expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.768947:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2779b8a00, rc 0) 00000100:00100000:2.0:1789760685.769016:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+28:10511:x1876699863094912:12345-192.168.203.12@tcp:101:rm.0 Request processed in 399us (581us total) trans 4294967334 rc 301/301 00000100:00100000:2.0:1789760685.769024:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:3.0:1789760685.779113:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760685.779201:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863095040 00000100:00100000:0.0:1789760685.779213:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863095040 00000100:00100000:0.0:1789760685.779272:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:0.0:1789760685.779283:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+28:10511:x1876699863095040:12345-192.168.203.12@tcp:37:rm.0 00000100:00100000:1.0:1789760685.793209:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+28:10511:x1876699863095040:12345-192.168.203.12@tcp:37:rm.0 Request processed in 13918us (14097us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760685.793221:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:1.0:1789760685.809248:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760685.809325:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863095296 00000100:00100000:2.0:1789760685.809335:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863095296 00000100:00100000:2.0:1789760685.809392:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:2.0:1789760685.809402:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2476c0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+28:10511:x1876699863095296:12345-192.168.203.12@tcp:35:rm.0 00000100:00100000:2.0:1789760685.809630:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2476c0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+29:10511:x1876699863095296:12345-192.168.203.12@tcp:35:rm.0 Request processed in 228us (390us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789760685.809638:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:2.0:1789760685.815312:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760685.815934:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863095552 00000100:00100000:0.0:1789760685.815949:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863095552 00000100:00100000:0.0:1789760685.816081:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:0.0:1789760685.816091:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+29:10511:x1876699863095552:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:0.0:1789760685.816119:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760685.816151:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04ae08e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d141 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.816254:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67e00/0x3e099f5ef04ae095 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.816271:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67e00/0x3e099f5ef04ae095 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.816282:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67e00/0x3e099f5ef04ae095 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760685.816294:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789760685.816414:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04ae08e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d141 expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.816453:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67e00/0x3e099f5ef04ae095 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d141 expref: 31 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.816462:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df250325c00) 00010000:00010000:0.0:1789760685.816465:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789760685.816469:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df243a67e00, rc 0) 00000100:00100000:0.0:1789760685.816539:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+31:10511:x1876699863095552:12345-192.168.203.12@tcp:101:rm.0 Request processed in 449us (1237us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1789760685.816546:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:2.0:1789760685.832392:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760685.832506:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863095680 00000100:00100000:3.0:1789760685.832516:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863095680 00000100:00100000:3.0:1789760685.832585:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:3.0:1789760685.832600:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+31:10511:x1876699863095680:12345-192.168.203.12@tcp:41:rm.0 00000004:00000024:3.0:1789760685.832661:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7670333440 00000100:00100000:3.0:1789760685.832721:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+31:10511:x1876699863095680:12345-192.168.203.12@tcp:41:rm.0 Request processed in 123us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760685.832726:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:1.0:1789760685.845636:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760685.845866:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863095936 00000100:00100000:2.0:1789760685.845876:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863095936 00000100:00100000:2.0:1789760685.845928:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:2.0:1789760685.845938:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+31:10511:x1876699863095936:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:2.0:1789760685.846012:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789760685.846040:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ae033 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0fb expref: 31 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.846063:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241539600/0x3e099f5ef04adedc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d06f expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.846074:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8df245dcca00) 00010000:00010000:2.0:1789760685.846089:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04ae079 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d133 expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.846098:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df250325c00) 00010000:00010000:2.0:1789760685.846100:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789760685.846120:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8a00/0x3e099f5ef04ae0a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.846133:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8a00/0x3e099f5ef04ae0a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.846142:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8a00/0x3e099f5ef04ae0a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.846156:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04ae0aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.846163:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04ae0aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.846169:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04ae0aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.847670:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8e00/0x3e099f5ef04ae0b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.847689:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8e00/0x3e099f5ef04ae0b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.847699:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8e00/0x3e099f5ef04ae0b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789760685.849149:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1789760685.849161:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 289962358238ns, next at 290962355317ns, rc = 0 00000040:00080000:3.0:1789760685.849410:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1789760685.849418:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 289962615356ns, next at 290962614107ns, rc = 0 00010000:00010000:3.0:1789760685.849488:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674a00/0x3e099f5ef04ae0b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.849502:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674a00/0x3e099f5ef04ae0b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.849512:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674a00/0x3e099f5ef04ae0b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.849520:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674a00/0x3e099f5ef04ae0b8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.849534:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674a00/0x3e099f5ef04ae0b8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.849540:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674a00/0x3e099f5ef04ae0b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.849621:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789760685.849642:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8e00/0x3e099f5ef04ae0b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.849648:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8e00/0x3e099f5ef04ae0b1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.849654:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8e00/0x3e099f5ef04ae0b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.849660:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b8e00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760685.849664:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8e00/0x3e099f5ef04ae0b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.849671:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8e00/0x3e099f5ef04ae0b1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.849683:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8df250325400) 00010000:00010000:3.0:1789760685.849686:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789760685.849690:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8e00/0x3e099f5ef04ae0b1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.849696:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8e00/0x3e099f5ef04ae0b1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.849711:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8a00/0x3e099f5ef04ae0a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.849722:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8a00/0x3e099f5ef04ae0a3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.849728:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8a00/0x3e099f5ef04ae0a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.849733:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b8a00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760685.849736:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8a00/0x3e099f5ef04ae0a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.849754:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8a00/0x3e099f5ef04ae0a3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.849763:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df250325c00) 00010000:00010000:3.0:1789760685.849765:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760685.849768:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8a00/0x3e099f5ef04ae0a3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.849773:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8a00/0x3e099f5ef04ae0a3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760685.849783:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed267813 reply state 0000000039ce3395 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04ae0aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760685.849791:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789760685.849890:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+30:10511:x1876699863095936:12345-192.168.203.12@tcp:36:rm.0 Request processed in 3951us (4260us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1789760685.849899:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 65 00010000:00010000:0.0:1789760685.855267:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04ae0aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.855288:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04ae0aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.855296:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04ae0aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.855302:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b9e00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760685.855307:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04ae0aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.855315:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04ae0aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.855332:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xe7cddcd6 (ffff8df250325b00) 00010000:00010000:0.0:1789760685.855335:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760685.855339:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04ae0aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.855357:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9e00/0x3e099f5ef04ae0aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760685.857072:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760685.857963:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863096192 00000100:00100000:2.0:1789760685.857976:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863096192 00000100:00100000:2.0:1789760685.858038:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:2.0:1789760685.858048:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+29:10511:x1876699863096192:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:2.0:1789760685.858106:0:7279:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789760685.858132:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9600/0x3e099f5ef04adfed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d0d1 expref: 29 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.858155:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04adf14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d07d expref: 28 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.858166:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df245dcc700) 00010000:00010000:2.0:1789760685.858175:0:7279:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789760685.858199:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04ae0bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.858215:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04ae0bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.858225:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04ae0bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.858272:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04ae0c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.858281:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04ae0c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.858288:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04ae0c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.858389:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9c00/0x3e099f5ef04ae0cd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.858409:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9c00/0x3e099f5ef04ae0cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.858416:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9c00/0x3e099f5ef04ae0cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.858840:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789760685.858848:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674a00/0x3e099f5ef04ae0b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.858856:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760685.858860:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674a00/0x3e099f5ef04ae0b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.858868:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674a00/0x3e099f5ef04ae0b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.858878:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8df250325400) 00010000:00010000:1.0:1789760685.858881:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789760685.858885:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674a00/0x3e099f5ef04ae0b8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.858891:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674a00/0x3e099f5ef04ae0b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760685.858906:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760685.858915:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760685.858917:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789760685.860517:0:7279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000040:00080000:3.0:1789760685.860552:0:7279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00010000:00010000:3.0:1789760685.860618:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675400/0x3e099f5ef04ae0d4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.860633:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675400/0x3e099f5ef04ae0d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.860642:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675400/0x3e099f5ef04ae0d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.860650:0:7279:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675400/0x3e099f5ef04ae0d4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.860656:0:7279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675400/0x3e099f5ef04ae0d4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.860662:0:7279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675400/0x3e099f5ef04ae0d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.860689:0:7279:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789760685.860708:0:7279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9c00/0x3e099f5ef04ae0cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.860714:0:7279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9c00/0x3e099f5ef04ae0cd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.860721:0:7279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9c00/0x3e099f5ef04ae0cd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.860726:0:7279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b9c00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760685.860731:0:7279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9c00/0x3e099f5ef04ae0cd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.860738:0:7279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9c00/0x3e099f5ef04ae0cd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.860769:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df250325a00) 00010000:00010000:3.0:1789760685.860771:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789760685.860776:0:7279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9c00/0x3e099f5ef04ae0cd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.860782:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9c00/0x3e099f5ef04ae0cd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.860799:0:7279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04ae0bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.860831:0:7279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04ae0bf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.860836:0:7279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04ae0bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.860841:0:7279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b8400 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760685.860844:0:7279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04ae0bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.860850:0:7279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04ae0bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.860858:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df250325c00) 00010000:00010000:3.0:1789760685.860861:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760685.860864:0:7279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04ae0bf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760685.860869:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8400/0x3e099f5ef04ae0bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760685.860890:0:7279:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005eb6f8cd reply state 000000005f24efa7 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04ae0c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760685.860899:0:7279:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789760685.861056:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+29:10511:x1876699863096192:12345-192.168.203.12@tcp:36:rm.0 Request processed in 3006us (3987us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1789760685.861065:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 66 00010000:00010000:0.0:1789760685.861155:0:7646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789760685.861163:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675400/0x3e099f5ef04ae0d4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.861169:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241675400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760685.861286:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675400/0x3e099f5ef04ae0d4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.861294:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675400/0x3e099f5ef04ae0d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.861305:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8df250325a00) 00010000:00010000:0.0:1789760685.861307:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789760685.861310:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675400/0x3e099f5ef04ae0d4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.861315:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675400/0x3e099f5ef04ae0d4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.861331:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760685.861333:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760685.861335:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760685.862545:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04ae0c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.862561:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04ae0c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.862569:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04ae0c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.862575:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b9a00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760685.862579:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04ae0c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.862603:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04ae0c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.862615:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x572a2e26 (ffff8df250325200) 00010000:00010000:2.0:1789760685.862618:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760685.862623:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04ae0c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760685.862629:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04ae0c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760685.865475:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760685.865694:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863096448 00000100:00100000:2.0:1789760685.865705:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863096448 00000100:00100000:2.0:1789760685.865774:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:2.0:1789760685.865785:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+28:10511:x1876699863096448:12345-192.168.203.12@tcp:35:rm.0 00000100:00100000:3.0:1789760685.866172:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+29:10511:x1876699863096448:12345-192.168.203.12@tcp:35:rm.0 Request processed in 388us (704us total) trans 4294967339 rc 0/0 00000100:00100000:3.0:1789760685.866180:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:3.0:1789760685.869609:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760685.880945:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863096704 00000100:00100000:0.0:1789760685.880972:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863096704 00000100:00100000:0.0:1789760685.881049:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:0.0:1789760685.881061:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+29:10511:x1876699863096704:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:0.0:1789760685.881152:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789760685.882826:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67e00/0x3e099f5ef04ae095 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d141 expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.882855:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9800/0x3e099f5ef04adeab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d061 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.882867:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df250325c00) 00010000:00010000:0.0:1789760685.882887:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8600/0x3e099f5ef04ade49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d04c expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.882896:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df250325700) 00010000:00010000:0.0:1789760685.882902:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760685.882927:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04ae0db lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.882939:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04ae0db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.882948:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04ae0db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.882960:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66c00/0x3e099f5ef04ae0e2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.882966:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66c00/0x3e099f5ef04ae0e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.882973:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66c00/0x3e099f5ef04ae0e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.883996:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae0e9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.884024:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae0e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.884034:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae0e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760685.884679:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789760685.884696:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae0e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.884704:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae0e9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.884712:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae0e9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.884719:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67a00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760685.884724:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae0e9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.884731:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae0e9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.884755:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8df2502f3800) 00010000:00010000:0.0:1789760685.884758:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789760685.884762:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae0e9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.884768:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae0e9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.884789:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04ae0db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.884826:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04ae0db lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.884833:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04ae0db lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.884839:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66000 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760685.884842:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04ae0db lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.884849:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04ae0db lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.884858:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df2502f3a00) 00010000:00010000:0.0:1789760685.884861:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760685.884864:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04ae0db lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.884870:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04ae0db lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789760685.884883:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b86e1091 reply state 00000000a254a7c5 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66c00/0x3e099f5ef04ae0e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760685.884891:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789760685.884988:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+28:10511:x1876699863096704:12345-192.168.203.12@tcp:36:rm.0 Request processed in 3925us (15383us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1789760685.884996:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 67 00010000:00010000:0.0:1789760685.890441:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66c00/0x3e099f5ef04ae0e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.890477:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66c00/0x3e099f5ef04ae0e2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.890485:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66c00/0x3e099f5ef04ae0e2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.890492:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66c00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760685.890497:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66c00/0x3e099f5ef04ae0e2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.890505:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66c00/0x3e099f5ef04ae0e2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.890531:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff8df2502f3500) 00010000:00010000:0.0:1789760685.890534:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760685.890539:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66c00/0x3e099f5ef04ae0e2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760685.890545:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66c00/0x3e099f5ef04ae0e2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.287573:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760686.878956:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760686.878999:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863096832 00000100:00100000:0.0:1789760686.879008:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863096832 00000100:00100000:0.0:1789760686.879057:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:0.0:1789760686.879067:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+27:10522:x1876699863096832:12345-192.168.203.12@tcp:101:mkdir.0 00010000:00010000:0.0:1789760686.879090:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760686.879113:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67e00/0x3e099f5ef04ae0f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d148 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.879188:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04ae0f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.879202:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04ae0f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.879214:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04ae0f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760686.879247:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789760686.879250:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789760686.879268:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04ae0f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.879289:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67e00/0x3e099f5ef04ae0f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d148 expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.879306:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04ae0f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d148 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.879315:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df2502f3500) 00010000:00010000:0.0:1789760686.879318:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789760686.879322:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df243a66a00, rc 0) 00000100:00100000:0.0:1789760686.879372:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+28:10522:x1876699863096832:12345-192.168.203.12@tcp:101:mkdir.0 Request processed in 306us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760686.879380:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:3.0:1789760686.883845:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760686.883898:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863097088 00000100:00100000:0.0:1789760686.883909:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863097088 00000100:00100000:0.0:1789760686.883974:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:0.0:1789760686.883985:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+28:10522:x1876699863097088:12345-192.168.203.12@tcp:36:mkdir.0 00010000:00010000:0.0:1789760686.884038:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760686.884064:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04ae0f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d148 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.884081:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df2502f3500) 00010000:00010000:0.0:1789760686.884091:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760686.884158:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae0fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.884170:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae0fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.884180:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae0fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.884192:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ae105 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.884199:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ae105 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.884206:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ae105 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760686.884840:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 16384 00010000:00010000:0.0:1789760686.884909:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae0fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.884917:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae0fe lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.884930:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae0fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.884935:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67600 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760686.884940:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae0fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.884947:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae0fe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.884957:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df2502f3a00) 00010000:00010000:0.0:1789760686.884959:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760686.884962:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae0fe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.884969:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae0fe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789760686.884983:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005dd4d510 reply state 00000000a26b6062 transno 4294967341 ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ae105 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760686.884992:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789760686.885066:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+29:10522:x1876699863097088:12345-192.168.203.12@tcp:36:mkdir.0 Request processed in 1081us (1228us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1789760686.885073:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 69 00010000:00010000:2.0:1789760686.887278:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ae105 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760686.887294:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ae105 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760686.887302:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ae105 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760686.887308:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67200 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760686.887312:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ae105 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760686.887319:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ae105 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760686.887349:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff8df2502f3800) 00010000:00010000:2.0:1789760686.887352:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760686.887357:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ae105 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760686.887363:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67200/0x3e099f5ef04ae105 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760686.907992:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760686.908869:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863097216 00000100:00100000:0.0:1789760686.908879:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863097216 00000100:00100000:0.0:1789760686.908935:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:0.0:1789760686.908944:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d366d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+28:10523:x1876699863097216:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1789760686.908977:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760686.908999:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae10c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d14f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.909064:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04ae113 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.909079:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04ae113 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.909092:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04ae113 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760686.909126:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789760686.909130:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789760686.909148:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04ae113 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.909169:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae10c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d14f expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.909185:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04ae113 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d14f expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.909194:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df2502f3a00) 00010000:00010000:0.0:1789760686.909197:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789760686.909200:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df243a66a00, rc 0) 00000100:00100000:0.0:1789760686.909254:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d366d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+29:10523:x1876699863097216:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 311us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760686.909260:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:0.0:1789760686.920353:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760686.921274:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863097472 00000100:00100000:3.0:1789760686.921287:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863097472 00000100:00100000:3.0:1789760686.921620:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:3.0:1789760686.921633:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+29:10523:x1876699863097472:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1789760686.921653:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760686.921655:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789760686.921678:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04ae113 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d14f expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.921693:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df2502f3a00) 00010000:00010000:3.0:1789760686.921702:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789760686.921722:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675e00/0x3e099f5ef04ae11a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d156 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.921904:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674600/0x3e099f5ef04ae121 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.921918:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674600/0x3e099f5ef04ae121 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.921929:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674600/0x3e099f5ef04ae121 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.921942:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04ae128 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.921949:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04ae128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.921956:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04ae128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.922057:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04ae12f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.922066:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04ae12f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.922072:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04ae12f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760686.922080:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 16384 00010000:00010000:3.0:1789760686.922094:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04ae12f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.922110:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04ae12f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.922116:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04ae12f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.922123:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674e00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760686.922128:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04ae12f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.922137:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04ae12f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.922146:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df245dcc700) 00010000:00010000:3.0:1789760686.922149:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760686.922152:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04ae12f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.922158:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04ae12f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.922176:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674600/0x3e099f5ef04ae121 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.922182:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674600/0x3e099f5ef04ae121 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.922188:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674600/0x3e099f5ef04ae121 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.922193:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674600 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760686.922202:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674600/0x3e099f5ef04ae121 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.922209:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674600/0x3e099f5ef04ae121 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.922218:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df245dcc800) 00010000:00010000:3.0:1789760686.922220:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760686.922223:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674600/0x3e099f5ef04ae121 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.922230:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674600/0x3e099f5ef04ae121 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.922241:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04ae128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.922246:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04ae128 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.922251:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04ae128 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.922257:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674200 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760686.922260:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04ae128 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.922267:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04ae128 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.922277:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff8df245dcc600) 00010000:00010000:3.0:1789760686.922278:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760686.922286:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04ae128 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.922293:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04ae128 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.922331:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675e00/0x3e099f5ef04ae11a lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d156 expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.922339:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df245dcc800) 00010000:00010000:3.0:1789760686.922342:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760686.922346:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675e00/0x3e099f5ef04ae11a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d156 expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.922359:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241675e00, rc 0) 00000100:00100000:3.0:1789760686.922438:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+28:10523:x1876699863097472:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 807us (2093us total) trans 0 rc 301/301 00000100:00100000:3.0:1789760686.922447:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:1.0:1789760686.929891:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760686.929975:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863097600 00000100:00100000:0.0:1789760686.929985:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863097600 00000100:00100000:0.0:1789760686.930044:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:0.0:1789760686.930054:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+28:10523:x1876699863097600:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1789760686.930074:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760686.930100:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae136 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d15d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.930166:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67e00/0x3e099f5ef04ae13d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.930181:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67e00/0x3e099f5ef04ae13d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.930193:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67e00/0x3e099f5ef04ae13d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760686.930229:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789760686.930233:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789760686.930251:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67e00/0x3e099f5ef04ae13d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.930274:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae136 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d15d expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.930290:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67e00/0x3e099f5ef04ae13d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d15d expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.930298:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df2502f3500) 00010000:00010000:0.0:1789760686.930308:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789760686.930312:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df243a67e00, rc 0) 00000100:00100000:0.0:1789760686.930365:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+29:10523:x1876699863097600:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 312us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760686.930371:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:3.0:1789760686.941150:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760686.941288:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863097856 00000100:00100000:0.0:1789760686.941299:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863097856 00000100:00100000:0.0:1789760686.941354:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:0.0:1789760686.941365:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d364000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+29:10523:x1876699863097856:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1789760686.941386:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760686.941407:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae144 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d164 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.941482:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ae14b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.941497:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ae14b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.941509:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ae14b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.941525:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae152 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.941532:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae152 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.941539:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae152 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760686.941659:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 16384 00010000:00010000:0.0:1789760686.941776:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ae14b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.941785:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ae14b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.941791:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ae14b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.941797:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66e00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760686.941824:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ae14b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.941833:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ae14b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.941845:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df2502f3500) 00010000:00010000:0.0:1789760686.941848:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760686.941852:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ae14b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.941858:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ae14b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.941869:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae152 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.941875:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae152 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.941893:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae152 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.941898:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67a00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760686.941901:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae152 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.941906:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae152 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.941914:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff8df2502f3600) 00010000:00010000:0.0:1789760686.941916:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760686.941919:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae152 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.941925:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae152 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.942152:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae144 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d164 expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.942163:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df2502f3500) 00010000:00010000:0.0:1789760686.942165:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789760686.942169:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae144 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d164 expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760686.942179:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df243a67600, rc 0) 00000100:00100000:0.0:1789760686.942276:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d364000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+30:10523:x1876699863097856:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 912us (1134us total) trans 4294967342 rc 301/301 00000100:00100000:0.0:1789760686.942293:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:2.0:1789760686.952314:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760686.952384:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863098112 00000100:00100000:3.0:1789760686.952394:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863098112 00000100:00100000:3.0:1789760686.952456:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:3.0:1789760686.952466:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+30:10523:x1876699863098112:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:3.0:1789760686.952549:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675e00/0x3e099f5ef04ae160 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.952565:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675e00/0x3e099f5ef04ae160 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.952577:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675e00/0x3e099f5ef04ae160 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760686.952788:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e834ca5 reply state 00000000b4b3ad2c transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675e00/0x3e099f5ef04ae160 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760686.952798:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789760686.952824:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 16384 00000100:00100000:3.0:1789760686.952897:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+32:10523:x1876699863098112:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 432us (591us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1789760686.952905:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 74 00010000:00010000:3.0:1789760686.966937:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675e00/0x3e099f5ef04ae160 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.966954:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675e00/0x3e099f5ef04ae160 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.966962:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675e00/0x3e099f5ef04ae160 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.966967:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241675e00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760686.966973:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675e00/0x3e099f5ef04ae160 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.966981:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675e00/0x3e099f5ef04ae160 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.966998:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df245dcc800) 00010000:00010000:3.0:1789760686.967001:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789760686.967005:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675e00/0x3e099f5ef04ae160 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.967011:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675e00/0x3e099f5ef04ae160 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760686.972321:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760686.972583:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863098368 00000100:00100000:2.0:1789760686.972593:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863098368 00000100:00100000:2.0:1789760686.972645:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1789760686.972655:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+31:10523:x1876699863098368:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1789760686.972907:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+32:10523:x1876699863098368:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 252us (592us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1789760686.972915:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:1.0:1789760686.984252:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760686.984376:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863098496 00000100:00100000:3.0:1789760686.984386:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863098496 00000100:00100000:3.0:1789760686.984531:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:3.0:1789760686.984543:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+32:10524:x1876699863098496:12345-192.168.203.12@tcp:101:chmod.0 00010000:00010000:3.0:1789760686.984568:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760686.984590:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675e00/0x3e099f5ef04ae167 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d16b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.984656:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04ae16e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.984671:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04ae16e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.984683:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04ae16e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.984700:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674600/0x3e099f5ef04ae175 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.984707:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674600/0x3e099f5ef04ae175 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.984715:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674600/0x3e099f5ef04ae175 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.984868:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04ae17c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.984876:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04ae17c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.984897:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04ae17c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760686.984929:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 16384 00000004:00200000:3.0:1789760686.984933:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789760686.984950:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04ae17c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.985028:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04ae16e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.985035:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04ae16e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.985042:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04ae16e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.985048:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674200 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760686.985052:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04ae16e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.985060:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04ae16e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.985071:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df2502f3500) 00010000:00010000:3.0:1789760686.985075:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760686.985078:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04ae16e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.985085:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04ae16e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.985108:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674600/0x3e099f5ef04ae175 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.985115:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674600/0x3e099f5ef04ae175 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.985121:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674600/0x3e099f5ef04ae175 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.985126:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674600 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760686.985130:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674600/0x3e099f5ef04ae175 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.985136:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674600/0x3e099f5ef04ae175 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.985143:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff8df245dcc800) 00010000:00010000:3.0:1789760686.985146:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760686.985148:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674600/0x3e099f5ef04ae175 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.985154:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674600/0x3e099f5ef04ae175 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.985184:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675e00/0x3e099f5ef04ae167 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d16b expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.985200:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04ae17c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d16b expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.985218:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df245dcc600) 00010000:00010000:3.0:1789760686.985221:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789760686.985224:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241674e00, rc 0) 00000100:00100000:3.0:1789760686.985275:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+33:10524:x1876699863098496:12345-192.168.203.12@tcp:101:chmod.0 Request processed in 734us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760686.985282:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:2.0:1789760686.996296:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760686.996372:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863098752 00000100:00100000:3.0:1789760686.996382:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863098752 00000100:00100000:3.0:1789760686.996437:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:3.0:1789760686.996447:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+33:10524:x1876699863098752:12345-192.168.203.12@tcp:36:chmod.0 00010000:00010000:3.0:1789760686.996501:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760686.996526:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04ae17c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d16b expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.996544:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df245dcc600) 00010000:00010000:3.0:1789760686.996555:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789760686.996578:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675e00/0x3e099f5ef04ae183 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.996592:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675e00/0x3e099f5ef04ae183 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.996601:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675e00/0x3e099f5ef04ae183 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760686.996858:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025c861f6 reply state 00000000ade861b4 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675e00/0x3e099f5ef04ae183 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760686.996883:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789760686.996892:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 16384 00000100:00100000:3.0:1789760686.996970:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+34:10524:x1876699863098752:12345-192.168.203.12@tcp:36:chmod.0 Request processed in 523us (682us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1789760686.996976:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 76 00010000:00010000:3.0:1789760686.999519:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675e00/0x3e099f5ef04ae183 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.999536:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675e00/0x3e099f5ef04ae183 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.999544:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675e00/0x3e099f5ef04ae183 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.999550:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241675e00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760686.999555:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675e00/0x3e099f5ef04ae183 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.999563:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675e00/0x3e099f5ef04ae183 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.999578:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df245dcc800) 00010000:00010000:3.0:1789760686.999580:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789760686.999585:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675e00/0x3e099f5ef04ae183 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760686.999592:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675e00/0x3e099f5ef04ae183 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760687.023886:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760687.023955:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863098880 00000100:00100000:0.0:1789760687.023966:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863098880 00000100:00100000:0.0:1789760687.024030:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:0.0:1789760687.024052:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+33:10525:x1876699863098880:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:0.0:1789760687.024076:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760687.024096:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae18a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d172 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.024171:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae191 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.024185:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae191 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.024195:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae191 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.024210:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ae198 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.024217:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ae198 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.024224:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ae198 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.024317:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04ae19f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.024342:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04ae19f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.024349:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04ae19f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760687.024377:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 16384 00000004:00200000:0.0:1789760687.024381:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789760687.024398:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04ae19f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.024410:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae191 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.024417:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae191 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.024423:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae191 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.024429:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67a00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760687.024434:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae191 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.024441:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae191 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.024453:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df2502f3500) 00010000:00010000:0.0:1789760687.024456:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760687.024460:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae191 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.024476:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae191 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.024489:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ae198 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.024495:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ae198 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.024501:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ae198 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.024506:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66e00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760687.024509:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ae198 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.024515:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ae198 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.024534:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff8df2502f3600) 00010000:00010000:0.0:1789760687.024537:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760687.024540:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ae198 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.024545:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66e00/0x3e099f5ef04ae198 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.024574:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae18a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d172 expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.024588:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04ae19f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d172 expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.024603:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df2502f3100) 00010000:00010000:0.0:1789760687.024605:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789760687.024608:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df243a66000, rc 0) 00000100:00100000:0.0:1789760687.024682:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+34:10525:x1876699863098880:12345-192.168.203.12@tcp:101:touch.0 Request processed in 642us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760687.024690:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00080000:1.0:1789760687.025441:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760687.031397:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760687.031494:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863099136 00000100:00100000:3.0:1789760687.031510:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863099136 00000100:00100000:3.0:1789760687.031566:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:3.0:1789760687.031577:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+34:10525:x1876699863099136:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:3.0:1789760687.031597:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760687.031615:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675e00/0x3e099f5ef04ae1a6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d179 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.031730:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04ae1ad lrc: 3/0,1 mode: --/CW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.031754:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04ae1ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.031764:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04ae1ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.032053:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674600/0x3e099f5ef04ae1b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.032064:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674600/0x3e099f5ef04ae1b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.032071:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674600/0x3e099f5ef04ae1b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789760687.032656:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1789760687.033176:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04ae1bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.033189:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04ae1bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.033209:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04ae1bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.033247:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04ae1ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.033254:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04ae1ad lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.033261:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04ae1ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.033267:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674e00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760687.033271:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04ae1ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.033277:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04ae1ad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.033289:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df2502f3100) 00010000:00010000:3.0:1789760687.033292:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760687.033296:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04ae1ad lrc: 2/0,0 mode: --/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.033301:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674e00/0x3e099f5ef04ae1ad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760687.033313:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dbb4cc7e reply state 00000000a120d800 transno 4294967346 ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674600/0x3e099f5ef04ae1b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760687.033321:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789760687.033358:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241675e00/0x3e099f5ef04ae1a6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d179 expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.033373:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04ae1bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d179 expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.033380:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df245dcc600) 00010000:00010000:3.0:1789760687.033382:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789760687.033384:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df241674200, rc 0) 00000100:00100000:3.0:1789760687.033471:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+37:10525:x1876699863099136:12345-192.168.203.12@tcp:101:touch.0 Request processed in 1888us (2075us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1789760687.033479:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 78 00010000:00010000:3.0:1789760687.034772:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674600/0x3e099f5ef04ae1b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.034786:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674600/0x3e099f5ef04ae1b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.034793:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674600/0x3e099f5ef04ae1b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.034822:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674600 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760687.034827:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674600/0x3e099f5ef04ae1b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.034835:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674600/0x3e099f5ef04ae1b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.034848:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x4009f790 (ffff8df245dcc800) 00010000:00010000:3.0:1789760687.034850:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760687.034866:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674600/0x3e099f5ef04ae1b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.034872:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674600/0x3e099f5ef04ae1b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760687.043490:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760687.043829:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863099392 00000100:00100000:0.0:1789760687.043839:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863099392 00000100:00100000:0.0:1789760687.043893:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:0.0:1789760687.043903:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+36:10525:x1876699863099392:12345-192.168.203.12@tcp:36:touch.0 00010000:00010000:0.0:1789760687.043954:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760687.043974:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df241674200/0x3e099f5ef04ae1bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d179 expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.043988:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df245dcc600) 00010000:00010000:0.0:1789760687.043995:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760687.044028:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae1c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.044048:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae1c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.044055:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae1c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789760687.044348:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e04b9c2c reply state 0000000036263074 transno 4294967347 ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae1c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760687.044369:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789760687.044460:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+37:10525:x1876699863099392:12345-192.168.203.12@tcp:36:touch.0 Request processed in 559us (980us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1789760687.044468:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:2.0:1789760687.046545:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00010000:00010000:3.0:1789760687.046546:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae1c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.046557:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae1c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.046565:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae1c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.046571:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67600 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760687.046575:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae1c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.046583:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae1c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.046599:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df2502f3600) 00010000:00010000:3.0:1789760687.046602:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760687.046606:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae1c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.046612:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae1c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760687.046620:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863099520 00000100:00100000:1.0:1789760687.046637:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863099520 00000100:00100000:1.0:1789760687.046686:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:1.0:1789760687.046695:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+36:10525:x1876699863099520:12345-192.168.203.12@tcp:101:touch.0 00010000:00010000:1.0:1789760687.046715:0:7279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760687.046731:0:7279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077000/0x3e099f5ef04ae1d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d180 expref: -99 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.046798:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077000/0x3e099f5ef04ae1d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d180 expref: 37 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.046830:0:7279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077000/0x3e099f5ef04ae1d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d180 expref: 37 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.046848:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df25b60d100) 00010000:00010000:1.0:1789760687.046851:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789760687.046853:0:7279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df24f077000, rc 0) 00000100:00100000:1.0:1789760687.046909:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+37:10525:x1876699863099520:12345-192.168.203.12@tcp:101:touch.0 Request processed in 214us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760687.046916:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:2.0:1789760687.049317:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760687.049401:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863099648 00000100:00100000:0.0:1789760687.049411:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863099648 00000100:00100000:0.0:1789760687.049485:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:0.0:1789760687.049496:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+48:2350:x1876699863099648:12345-192.168.203.12@tcp:2:touch.0 00000100:00100000:0.0:1789760687.049859:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+49:2350:x1876699863099648:12345-192.168.203.12@tcp:2:touch.0 Request processed in 364us (548us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789760687.049867:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00080000:1.0:1789760687.051190:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760687.053389:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760687.053473:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863099904 00000100:00100000:1.0:1789760687.053484:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863099904 00000100:00100000:1.0:1789760687.053537:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:1.0:1789760687.053561:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+37:10525:x1876699863099904:12345-192.168.203.12@tcp:35:touch.0 00000100:00100000:1.0:1789760687.054206:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+38:10525:x1876699863099904:12345-192.168.203.12@tcp:35:touch.0 Request processed in 645us (822us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1789760687.054215:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:2.0:1789760687.066496:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760687.067371:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863100032 00000100:00100000:3.0:1789760687.067382:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863100032 00000100:00100000:2.0:1789760687.067545:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:2.0:1789760687.067557:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+38:10526:x1876699863100032:12345-192.168.203.12@tcp:101:chmod.0 00010000:00010000:2.0:1789760687.067595:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760687.067618:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9200/0x3e099f5ef04ae1d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d187 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.067683:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04ae1de lrc: 3/1,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.067696:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04ae1de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.067707:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04ae1de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.067722:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8000/0x3e099f5ef04ae1e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.067729:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8000/0x3e099f5ef04ae1e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.067747:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8000/0x3e099f5ef04ae1e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.067865:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04ae1ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.067874:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04ae1ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.067881:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04ae1ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760687.067914:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789760687.067923:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789760687.067945:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04ae1ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.067956:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04ae1ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.067964:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04ae1de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.067970:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04ae1de lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.067977:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04ae1de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.067983:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b9400 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760687.067987:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04ae1de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.067995:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04ae1de lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.068005:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df2502f3100) 00010000:00010000:2.0:1789760687.068008:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760687.068011:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04ae1de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.068016:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04ae1de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.068029:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8000/0x3e099f5ef04ae1e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.068048:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8000/0x3e099f5ef04ae1e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.068055:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8000/0x3e099f5ef04ae1e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.068060:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b8000 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760687.068063:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8000/0x3e099f5ef04ae1e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.068070:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8000/0x3e099f5ef04ae1e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.068079:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x4009f790 (ffff8df250325e00) 00010000:00010000:2.0:1789760687.068082:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760687.068085:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8000/0x3e099f5ef04ae1e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.068091:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8000/0x3e099f5ef04ae1e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.068127:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9200/0x3e099f5ef04ae1d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d187 expref: 40 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.068144:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04ae1ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d187 expref: 39 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.068152:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df25b60d100) 00010000:00010000:2.0:1789760687.068155:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789760687.068164:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2779b9a00, rc 0) 00000100:00100000:2.0:1789760687.068238:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+39:10526:x1876699863100032:12345-192.168.203.12@tcp:101:chmod.0 Request processed in 682us (1753us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760687.068247:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:3.0:1789760687.071896:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760687.071993:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863100160 00000100:00100000:0.0:1789760687.072004:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863100160 00000100:00100000:0.0:1789760687.072060:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:0.0:1789760687.072071:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d367100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+49:2349:x1876699863100160:12345-192.168.203.12@tcp:101:chmod.0 00010000:00010000:0.0:1789760687.072088:0:8482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760687.072108:0:8482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae1f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d18e expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760687.072135:0:8482:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x6aad94ae, atime: 0x6aad94ae, ctime: 0x6aad94ae, blocks: 0x1 00010000:00010000:0.0:1789760687.072153:0:8482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=291s v=(0 0) 00010000:00010000:0.0:1789760687.072159:0:8482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760687.072179:0:8482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae1f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d18e expref: 50 pid: 8482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.072212:0:8482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae1f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d18e expref: 50 pid: 8482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.072225:0:8482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df243a66e00, rc 0) 00000100:00100000:0.0:1789760687.072281:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d367100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+50:2349:x1876699863100160:12345-192.168.203.12@tcp:101:chmod.0 Request processed in 211us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760687.072288:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:3.0:1789760687.076296:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760687.076513:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863100416 00000100:00100000:1.0:1789760687.076524:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863100416 00000100:00100000:1.0:1789760687.076579:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:1.0:1789760687.076589:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+39:10526:x1876699863100416:12345-192.168.203.12@tcp:36:chmod.0 00010000:00010000:1.0:1789760687.076650:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760687.076676:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9a00/0x3e099f5ef04ae1ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d187 expref: 39 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.076694:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df25b60d100) 00010000:00010000:1.0:1789760687.076700:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789760687.076731:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077800/0x3e099f5ef04ae1fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.076754:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077800/0x3e099f5ef04ae1fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.076764:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077800/0x3e099f5ef04ae1fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789760687.077673:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004684e734 reply state 00000000d4067127 transno 4294967349 ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077800/0x3e099f5ef04ae1fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760687.077686:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789760687.077794:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+40:10526:x1876699863100416:12345-192.168.203.12@tcp:36:chmod.0 Request processed in 1205us (1505us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1789760687.077852:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:2.0:1789760687.080981:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00010000:00010000:3.0:1789760687.081052:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077800/0x3e099f5ef04ae1fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760687.081053:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863100544 00000100:00100000:0.0:1789760687.081062:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863100544 00010000:00010000:3.0:1789760687.081063:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077800/0x3e099f5ef04ae1fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.081070:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077800/0x3e099f5ef04ae1fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.081076:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f077800 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760687.081081:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077800/0x3e099f5ef04ae1fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.081088:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077800/0x3e099f5ef04ae1fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.081103:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df25b60d100) 00010000:00010000:3.0:1789760687.081107:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789760687.081111:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077800/0x3e099f5ef04ae1fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760687.081115:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 48 00010000:00010000:3.0:1789760687.081117:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077800/0x3e099f5ef04ae1fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760687.081124:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+50:2348:x1876699863100544:12345-192.168.203.12@tcp:2:chmod.0 00002000:00010000:0.0:1789760687.081301:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789760687.081305:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789760686 -> 1789760686 00002000:00010000:0.0:1789760687.081308:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 1789760686 -> 1789760686 00002000:00010000:0.0:1789760687.081310:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789760686 -> 1789760686 00002000:00010000:0.0:1789760687.081312:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789760687.081361:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+51:2348:x1876699863100544:12345-192.168.203.12@tcp:2:chmod.0 Request processed in 237us (397us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1789760687.081370:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:3.0:1789760687.112780:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760687.112922:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863100800 00000100:00100000:2.0:1789760687.112932:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863100800 00000100:00100000:2.0:1789760687.113118:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:2.0:1789760687.113130:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+39:10532:x1876699863100800:12345-192.168.203.12@tcp:101:dd.500 00010000:00010000:2.0:1789760687.113153:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760687.113183:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9200/0x3e099f5ef04ae201 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d195 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.113337:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8000/0x3e099f5ef04ae208 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.113350:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8000/0x3e099f5ef04ae208 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.113361:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8000/0x3e099f5ef04ae208 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.113375:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04ae20f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.113382:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04ae20f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.113387:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04ae20f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.113463:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9800/0x3e099f5ef04ae216 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.113473:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9800/0x3e099f5ef04ae216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.113480:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9800/0x3e099f5ef04ae216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760687.113489:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789760687.113577:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8000/0x3e099f5ef04ae208 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.113585:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8000/0x3e099f5ef04ae208 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.113591:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8000/0x3e099f5ef04ae208 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.113598:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b8000 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760687.113602:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8000/0x3e099f5ef04ae208 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.113609:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8000/0x3e099f5ef04ae208 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.113620:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df2502f3100) 00010000:00010000:2.0:1789760687.113623:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760687.113627:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8000/0x3e099f5ef04ae208 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.113644:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b8000/0x3e099f5ef04ae208 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.113657:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04ae20f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.113663:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04ae20f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.113668:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04ae20f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.113672:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b9400 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760687.113675:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04ae20f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.113680:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04ae20f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.113688:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x4009f790 (ffff8df250325e00) 00010000:00010000:2.0:1789760687.113690:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760687.113693:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04ae20f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.113698:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9400/0x3e099f5ef04ae20f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.113747:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9200/0x3e099f5ef04ae201 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d195 expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.113760:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9800/0x3e099f5ef04ae216 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d195 expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.113773:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df25b60d100) 00010000:00010000:2.0:1789760687.113776:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789760687.113778:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2779b9800, rc 0) 00000100:00100000:2.0:1789760687.114302:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+41:10532:x1876699863100800:12345-192.168.203.12@tcp:101:dd.500 Request processed in 1172us (1529us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1789760687.114310:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:3.0:1789760687.117300:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760687.117393:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863101056 00000100:00100000:2.0:1789760687.117403:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863101056 00000100:00100000:2.0:1789760687.117461:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:2.0:1789760687.117473:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+41:10532:x1876699863101056:12345-192.168.203.12@tcp:36:dd.500 00010000:00010000:2.0:1789760687.117526:0:7279:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760687.117551:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9800/0x3e099f5ef04ae216 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d195 expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.117570:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df25b60d100) 00010000:00010000:2.0:1789760687.117575:0:7279:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789760687.117775:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9600/0x3e099f5ef04ae224 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.117788:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9600/0x3e099f5ef04ae224 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.117797:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9600/0x3e099f5ef04ae224 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760687.117872:0:7279:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967351 00000004:00010000:2.0:1789760687.117898:0:7279:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000826cfd81 reply state 00000000deaa94b0 transno 4294967352 ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9600/0x3e099f5ef04ae224 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760687.117919:0:7279:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789760687.118013:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+43:10532:x1876699863101056:12345-192.168.203.12@tcp:36:dd.500 Request processed in 542us (721us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1789760687.118021:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 84 00000020:00080000:2.0:1789760687.118025:0:7279:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789760687.119977:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9600/0x3e099f5ef04ae224 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.119992:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9600/0x3e099f5ef04ae224 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.120016:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9600/0x3e099f5ef04ae224 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.120022:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b9600 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760687.120027:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9600/0x3e099f5ef04ae224 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.120035:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9600/0x3e099f5ef04ae224 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.120049:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df25b60d100) 00010000:00010000:3.0:1789760687.120052:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760687.120056:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9600/0x3e099f5ef04ae224 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.120062:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2779b9600/0x3e099f5ef04ae224 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760687.121791:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760687.122177:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863101184 00000100:00100000:1.0:1789760687.122188:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863101184 00000100:00100000:1.0:1789760687.122247:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:1.0:1789760687.122258:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d364380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+51:10532:x1876699863101184:12345-192.168.203.12@tcp:101:dd.500 00010000:00010000:1.0:1789760687.122277:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760687.122294:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae22b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d19c expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.122323:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae1f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d18e expref: 52 pid: 8482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.122333:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760687.122337:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760687.122342:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae22b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d19c expref: 52 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.122375:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae1f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d18e expref: 52 pid: 8482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.122389:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae1f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d18e expref: 52 pid: 8482 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760687.122403:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df144667b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1876699883037696:192.168.203.12@tcp:104: 00000100:00100000:1.0:1789760687.122487:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df258f64180 going to sleep for 11 seconds 00000100:00100000:2.0:1789760687.127715:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760687.127791:0:7645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863101312 00000100:00100000:3.0:1789760687.127829:0:7645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863101312 00010000:00010000:3.0:1789760687.127866:0:7645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae1f3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d18e expref: 53 pid: 8482 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760687.127909:0:7645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:3.0:1789760687.127919:0:7645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144604700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1da0113a-370d-4d79-883c-54efc174697f+53:2348:x1876699863101312:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789760687.127931:0:7645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760687.127936:0:7645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae1f3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d18e expref: 53 pid: 8482 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.127963:0:7645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae1f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d18e expref: 53 pid: 8482 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.128001:0:7645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760687.128006:0:7645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760687.128012:0:7645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae22b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d19c expref: 53 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.128023:0:7645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae22b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d19c expref: 53 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.128060:0:7645:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae22b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d19c expref: 53 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760687.128074:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d367800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7645:1876699883037824:192.168.203.12@tcp:105: 00000100:00100000:3.0:1789760687.128150:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df27ce939c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789760687.128644:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae1f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d18e expref: 53 pid: 8482 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760687.128659:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df144667b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1876699883037696:192.168.203.12@tcp:104: 00010000:00010000:1.0:1789760687.128683:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae22b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d19c expref: 52 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.128695:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df24f077c00, rc 0) 00000100:00100000:1.0:1789760687.128740:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d364380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+52:10532:x1876699863101184:12345-192.168.203.12@tcp:101:dd.500 Request processed in 6476us (6948us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760687.128748:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:2.0:1789760687.133151:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760687.133236:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863101440 00000100:00100000:0.0:1789760687.133245:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863101440 00002000:00010000:0.0:1789760687.133284:0:11796:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/4 (0->18446744073709551615) 00002000:00100000:0.0:1789760687.133288:0:11796:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df144607480 with x1876699863101440 ext(0->18446744073709551615) 00002000:00010000:0.0:1789760687.133299:0:11796:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df144607480. 00000100:00100000:0.0:1789760687.133324:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 289532882049 time 289534497347 state 0x0 ref 1 00000100:00100000:0.0:1789760687.133335:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 289734497347 time 289534497347 state 0x1 ref 1 00000100:00100000:0.0:1789760687.133361:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 2 deadline 289734497347 time 291246556131 state 0x0 ref 1 00000100:00100000:0.0:1789760687.133372:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144607480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+52:2349:x1876699863101440:12345-192.168.203.12@tcp:10:dd.500 00002000:00010000:0.0:1789760687.133632:0:11796:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789760687.133635:0:11796:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789760686 -> 1789760686 00002000:00010000:0.0:1789760687.133638:0:11796:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 1789760686 -> 1789760686 00002000:00010000:0.0:1789760687.133640:0:11796:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789760686 -> 1789760686 00002000:00010000:0.0:1789760687.133641:0:11796:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789760687.133699:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144607480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+53:2349:x1876699863101440:12345-192.168.203.12@tcp:10:dd.500 Request processed in 329us (558us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1789760687.133706:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:0.0:1789760687.133710:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 2 deadline 289734497347 time 291246556131 state 0x2 ref 0 00002000:00010000:0.0:1789760687.133715:0:11796:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/4 (0->18446744073709551615) 00002000:00100000:0.0:1789760687.133718:0:11796:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df144607480 with x1876699863101440 ext(0->18446744073709551615) 00002000:00010000:0.0:1789760687.133722:0:11796:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df144607480. 00000100:00100000:3.0:1789760687.134235:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d367800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7645:1876699883037824:192.168.203.12@tcp:105: 00010000:00010000:3.0:1789760687.134259:0:7645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760687.134368:0:7645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144604700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1da0113a-370d-4d79-883c-54efc174697f+52:2348:x1876699863101312:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 6449us (6662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760687.134538:0:7645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:2.0:1789760687.138688:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760687.138888:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863101568 00000100:00100000:0.0:1789760687.138898:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863101568 00000100:00100000:0.0:1789760687.138956:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 2 deadline 289734497347 time 291246556131 state 0x0 ref 1 00000100:00100000:0.0:1789760687.138969:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 2 deadline 291446556131 time 291246556131 state 0x1 ref 1 00000100:00100000:0.0:1789760687.139047:0:11800:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 1 deadline 291446556131 time 291252241561 state 0x0 ref 1 00000100:00100000:0.0:1789760687.139060:0:11800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+52:2351:x1876699863101568:12345-192.168.203.12@tcp:4:dd.500 00010000:00010000:0.0:1789760687.139091:0:11800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae232 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.139111:0:11800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae22b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d19c expref: 52 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.139119:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760687.139124:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789760687.139129:0:11800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae232 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.139164:0:11800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae22b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d19c expref: 52 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.139177:0:11800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae22b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d19c expref: 52 pid: 6693 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760687.139196:0:11800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc44700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0000_UUID:11800:1876699883037952:192.168.203.12@tcp:104: 00000100:00100000:0.0:1789760687.139283:0:11800:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259acd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760687.141133:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760687.141359:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863101696 00000100:00100000:1.0:1789760687.141366:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863101696 00010000:00010000:1.0:1789760687.141397:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae22b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d19c expref: 53 pid: 6693 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760687.141438:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:1.0:1789760687.141447:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d367800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1da0113a-370d-4d79-883c-54efc174697f+53:2348:x1876699863101696:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789760687.141460:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760687.141485:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae22b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d19c expref: 53 pid: 6693 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.141499:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae22b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d19c expref: 53 pid: 6693 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.141524:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789760687.141544:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789760687.141549:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae232 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.141559:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae232 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.141579:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760687.141684:0:11800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae22b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d19c expref: 53 pid: 6693 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760687.141713:0:11800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc44700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0000_UUID:11800:1876699883037952:192.168.203.12@tcp:104: 00000100:00100000:1.0:1789760687.141719:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d367800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1da0113a-370d-4d79-883c-54efc174697f+52:2348:x1876699863101696:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 273us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760687.141726:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 36 00010000:00010000:0.0:1789760687.141795:0:11800:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae232 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.141849:0:11800:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae232 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.141857:0:11800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae232 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760687.241944:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967347 is committed 00000001:00080000:2.0:1789760687.241978:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000001:00080000:2.0:1789760687.241992:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:2.0:1789760687.242023:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:2.0:1789760687.242033:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1789760687.242430:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789760687.242450:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df144606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883038080:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789760687.242513:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760687.242605:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789760687.242613:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df144605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883038208:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789760687.242641:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760687.242656:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883038080 00000100:00100000:3.0:1789760687.242663:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883038080 00000100:00100000:2.0:1789760687.242665:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883038208 00000100:00100000:2.0:1789760687.242668:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883038208 00000100:00100000:3.0:1789760687.242783:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789760687.242792:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1876699883038080:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789760687.242839:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00002000:00080000:3.0:1789760687.242842:0:6694:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00000100:00100000:2.0:1789760687.242845:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883038208:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789760687.242857:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00010000:00010000:2.0:1789760687.242871:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030dd9000/0x3e099f5ef04ae240 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760687.242872:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 8388608, mtime: 0x6aad94ab, atime: 0x6aad94a9, ctime: 0x6aad94ab, blocks: 0x4007 00010000:00010000:3.0:1789760687.242878:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071fdf06e/0x3e099f5ef04ae239 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.242887:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=291s v=(0 0) 00010000:00010000:2.0:1789760687.242891:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae041 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d109 expref: 54 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.242891:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760687.242897:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071fdf06e/0x3e099f5ef04ae239 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.242912:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071fdf06e/0x3e099f5ef04ae239 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.242921:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071fdf06e/0x3e099f5ef04ae239 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.242929:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071fdf06e/0x3e099f5ef04ae239 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.242946:0:6694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789760687.242973:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae06b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d12c expref: 54 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.242981:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae064 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d125 expref: 54 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.242989:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae05d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d11e expref: 54 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.242997:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae056 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d117 expref: 54 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.243004:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae04f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d110 expref: 54 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.243012:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000096f1774f/0x3e099f5ef04ae048 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d102 expref: 54 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.243019:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789760687.243022:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760687.243026:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030dd9000/0x3e099f5ef04ae240 lrc: 10/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.243049:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000096f1774f/0x3e099f5ef04ae048 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d102 expref: 54 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.243067:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000096f1774f/0x3e099f5ef04ae048 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d102 expref: 54 pid: 6693 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760687.243078:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df144604000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1876699883038336:192.168.203.12@tcp:104: 00010000:00010000:2.0:1789760687.243141:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae04f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d110 expref: 54 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.243151:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae04f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d110 expref: 54 pid: 6694 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760687.243159:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df144607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1876699883038464:192.168.203.12@tcp:104: 00010000:00010000:2.0:1789760687.243254:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae056 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d117 expref: 54 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.243263:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae056 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d117 expref: 54 pid: 6695 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760687.243272:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df144607b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1876699883038592:192.168.203.12@tcp:104: 00010000:00010000:2.0:1789760687.243301:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae05d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d11e expref: 54 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.243310:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae05d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d11e expref: 54 pid: 6695 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760687.243330:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df144606300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1876699883038720:192.168.203.12@tcp:104: 00010000:00010000:2.0:1789760687.243359:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae064 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d125 expref: 54 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.243368:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae064 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d125 expref: 54 pid: 6693 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760687.243377:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df144605c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1876699883038848:192.168.203.12@tcp:104: 00010000:00010000:2.0:1789760687.243413:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae06b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d12c expref: 54 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.243423:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae06b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d12c expref: 54 pid: 8482 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760687.243432:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df142e40380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1876699883038976:192.168.203.12@tcp:104: 00000100:00100000:3.0:1789760687.243434:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3309:x1876699883038080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 644us (921us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1789760687.243442:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1789760687.243459:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae041 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d109 expref: 54 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789760687.243463:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789760687.243466:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789760687.243479:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760687.243484:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071fdf06e/0x3e099f5ef04ae239 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.243493:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760687.243497:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071fdf06e/0x3e099f5ef04ae239 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.243506:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071fdf06e/0x3e099f5ef04ae239 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.243523:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071fdf06e/0x3e099f5ef04ae239 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.243531:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071fdf06e/0x3e099f5ef04ae239 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.243535:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae041 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d109 expref: 54 pid: 6693 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760687.243544:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df142e40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1876699883039104:192.168.203.12@tcp:104: 00010000:00010000:3.0:1789760687.243560:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760687.243562:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760687.243564:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760687.243583:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df25857d480 going to sleep for 11 seconds 00000004:00080000:3.0:1789760687.243590:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df144606680/2, rc 0, transno 4294967322 00000100:00100000:3.0:1789760687.243599:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df144606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883038080:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789760687.246988:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760687.247020:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760687.247038:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760687.247057:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760687.247089:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760687.247116:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760687.247322:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863101824 00000100:00100000:1.0:1789760687.247332:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863101824 00010000:00010000:1.0:1789760687.247371:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000096f1774f/0x3e099f5ef04ae048 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d102 expref: 55 pid: 6693 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760687.247397:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863102080 00000100:00100000:1.0:1789760687.247400:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863102080 00010000:00010000:1.0:1789760687.247412:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae056 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d117 expref: 56 pid: 6695 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760687.247424:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863102336 00000100:00100000:1.0:1789760687.247426:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863102336 00010000:00010000:1.0:1789760687.247436:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae064 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d125 expref: 57 pid: 6693 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760687.247446:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863101952 00000100:00100000:1.0:1789760687.247449:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863101952 00010000:00010000:1.0:1789760687.247459:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae04f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d110 expref: 58 pid: 6694 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760687.247492:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863102208 00000100:00100000:1.0:1789760687.247495:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863102208 00010000:00010000:1.0:1789760687.247507:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae05d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d11e expref: 59 pid: 6695 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760687.247517:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863102464 00000100:00100000:1.0:1789760687.247519:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863102464 00010000:00010000:1.0:1789760687.247529:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae06b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d12c expref: 60 pid: 8482 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760687.247543:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:1.0:1789760687.247553:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df260391c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1da0113a-370d-4d79-883c-54efc174697f+60:2350:x1876699863101824:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789760687.247565:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760687.247571:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000096f1774f/0x3e099f5ef04ae048 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d102 expref: 60 pid: 6693 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.247584:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000096f1774f/0x3e099f5ef04ae048 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d102 expref: 60 pid: 6693 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760687.247607:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 38 00010000:00010000:1.0:1789760687.247611:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760687.247621:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d365180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1da0113a-370d-4d79-883c-54efc174697f+60:2350:x1876699863102080:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789760687.247633:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760687.247639:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae056 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d117 expref: 60 pid: 6695 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.247651:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae056 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d117 expref: 60 pid: 6695 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760687.247665:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df260391c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1da0113a-370d-4d79-883c-54efc174697f+60:2350:x1876699863101824:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 111us (684us total) trans 0 rc 0/0 00010000:00010000:0.0:1789760687.247667:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760687.247675:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:0.0:1789760687.247697:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d365180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1da0113a-370d-4d79-883c-54efc174697f+59:2350:x1876699863102080:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 78us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760687.247706:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:1.0:1789760687.247723:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:0.0:1789760687.247740:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:1.0:1789760687.247747:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d365500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1da0113a-370d-4d79-883c-54efc174697f+58:2350:x1876699863102336:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789760687.247765:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789760687.247769:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d367b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1da0113a-370d-4d79-883c-54efc174697f+58:2350:x1876699863101952:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789760687.247774:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae064 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d125 expref: 58 pid: 6693 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.247782:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760687.247788:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae064 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d125 expref: 58 pid: 6693 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.247792:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae04f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d110 expref: 58 pid: 6694 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.248161:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae04f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d110 expref: 58 pid: 6694 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.248176:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760687.248200:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d367b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1da0113a-370d-4d79-883c-54efc174697f+58:2350:x1876699863101952:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 444us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760687.248207:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:0.0:1789760687.248223:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:0.0:1789760687.248232:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14347f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1da0113a-370d-4d79-883c-54efc174697f+57:2350:x1876699863102208:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789760687.248239:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760687.248244:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae05d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d11e expref: 57 pid: 6695 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.248246:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760687.248258:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae05d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d11e expref: 57 pid: 6695 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.248271:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760687.248274:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d365500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1da0113a-370d-4d79-883c-54efc174697f+57:2350:x1876699863102336:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 541us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760687.248283:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:0.0:1789760687.248296:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14347f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1da0113a-370d-4d79-883c-54efc174697f+56:2350:x1876699863102208:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 65us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760687.248301:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:1.0:1789760687.248309:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14347df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1da0113a-370d-4d79-883c-54efc174697f+56:2350:x1876699863102464:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789760687.248316:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760687.248321:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae06b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d12c expref: 56 pid: 8482 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.248331:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae06b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d12c expref: 56 pid: 8482 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.248343:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760687.248360:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14347df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1da0113a-370d-4d79-883c-54efc174697f+56:2350:x1876699863102464:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 52us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760687.248366:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:0.0:1789760687.248540:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 41 00010000:00010000:2.0:1789760687.249544:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096f1774f/0x3e099f5ef04ae048 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d102 expref: 54 pid: 6693 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760687.249565:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df144604000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1876699883038336:192.168.203.12@tcp:104: 00010000:00010000:2.0:1789760687.249580:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae04f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d110 expref: 53 pid: 6694 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760687.249590:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df144607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1876699883038464:192.168.203.12@tcp:104: 00010000:00010000:2.0:1789760687.249602:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae056 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d117 expref: 52 pid: 6695 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760687.249612:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df144607b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1876699883038592:192.168.203.12@tcp:104: 00010000:00010000:2.0:1789760687.249622:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae05d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d11e expref: 51 pid: 6695 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760687.249632:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df144606300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1876699883038720:192.168.203.12@tcp:104: 00010000:00010000:2.0:1789760687.249642:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae064 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d125 expref: 50 pid: 6693 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760687.249652:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df144605c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1876699883038848:192.168.203.12@tcp:104: 00010000:00010000:2.0:1789760687.249661:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae06b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d12c expref: 49 pid: 8482 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760687.249684:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df142e40380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1876699883038976:192.168.203.12@tcp:104: 00000100:00100000:2.0:1789760687.249696:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df142e40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1876699883039104:192.168.203.12@tcp:104: 00010000:00010000:2.0:1789760687.249728:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000030dd9000/0x3e099f5ef04ae240 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760687.250565:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00002000:00010000:0.0:1789760687.251601:0:11800:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:0.0:1789760687.251613:0:11800:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:0.0:1789760687.251626:0:11800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae232 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.251637:0:11800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae232 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.251645:0:11800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae232 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.251653:0:11800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760687.251658:0:11800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae232 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.251666:0:11800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae232 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.251686:0:11800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae232 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.251694:0:11800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae232 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760687.251789:0:11800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863101568:12345-192.168.203.12@tcp:4:dd.500 Request processed in 112727us (113106us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1789760687.251799:0:11800:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:0.0:1789760687.251831:0:11800:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 1 deadline 291446556131 time 291252241561 state 0x2 ref 0 00000100:00100000:0.0:1789760687.253277:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760687.253602:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863102592 00000100:00100000:1.0:1789760687.253622:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863102592 00010000:00010000:1.0:1789760687.253658:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae041 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d109 expref: 6 pid: 6693 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760687.253694:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:1.0:1789760687.253703:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863102592:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789760687.254328:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760687.254337:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae041 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d109 expref: 6 pid: 6693 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.254351:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae041 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d109 expref: 6 pid: 6693 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.254372:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae041 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d109 expref: 6 pid: 6693 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.254389:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760687.254393:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760687.254398:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000030dd9000/0x3e099f5ef04ae240 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.254407:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030dd9000/0x3e099f5ef04ae240 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.254444:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760687.254498:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863102592:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 795us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760687.254516:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00010000:00010000:3.0:1789760687.254833:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000030dd9000/0x3e099f5ef04ae240 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.254843:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030dd9000/0x3e099f5ef04ae240 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.254852:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030dd9000/0x3e099f5ef04ae240 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.254860:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030dd9000/0x3e099f5ef04ae240 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.254879:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789760687.255193:0:7646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789760687.255200:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030dd9000/0x3e099f5ef04ae240 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.255208:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b9800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760687.255212:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030dd9000/0x3e099f5ef04ae240 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.255222:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030dd9000/0x3e099f5ef04ae240 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.255236:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030dd9000/0x3e099f5ef04ae240 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.255244:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030dd9000/0x3e099f5ef04ae240 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760687.255630:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1876699883038208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12782us (12985us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1789760687.255639:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:1.0:1789760687.255782:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760687.255784:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760687.255786:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789760687.256064:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df144605880/2, rc 0, transno 4294967324 00000100:00100000:2.0:1789760687.256078:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df144605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883038208:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1789760687.260449:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:3.0:1789760687.260529:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1789760687.289689:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760687.290166:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863102720 00000100:00100000:2.0:1789760687.290176:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863102720 00000100:00100000:3.0:1789760687.290301:0:6699:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 1 deadline 291446556131 time 291252241561 state 0x0 ref 1 00000100:00100000:3.0:1789760687.290314:0:6699:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 1 deadline 291452241561 time 291252241561 state 0x1 ref 1 00000100:00100000:3.0:1789760687.290376:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 291452241561 time 291403570883 state 0x0 ref 1 00000100:00100000:3.0:1789760687.290390:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14347e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863102720:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760687.290440:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 1048576, mtime: 0x6aad94ae, atime: 0x6aad94ae, ctime: 0x6aad94ae, blocks: 0x803 00010000:00010000:3.0:1789760687.290459:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071fdf06e/0x3e099f5ef04ae247 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.290476:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=291s v=(0 0) 00010000:00010000:3.0:1789760687.290480:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760687.290485:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071fdf06e/0x3e099f5ef04ae247 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760687.290500:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071fdf06e/0x3e099f5ef04ae247 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.316876:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789760687.366458:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:1.0:1789760687.366465:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:1.0:1789760687.366480:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071fdf06e/0x3e099f5ef04ae247 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.366502:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071fdf06e/0x3e099f5ef04ae247 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.366518:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071fdf06e/0x3e099f5ef04ae247 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.366526:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760687.366531:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071fdf06e/0x3e099f5ef04ae247 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.366540:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071fdf06e/0x3e099f5ef04ae247 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.366562:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071fdf06e/0x3e099f5ef04ae247 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.366570:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071fdf06e/0x3e099f5ef04ae247 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760687.366669:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14347e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+7:2349:x1876699863102720:12345-192.168.203.12@tcp:4:dd.500 Request processed in 76277us (76985us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1789760687.366680:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:1.0:1789760687.366688:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 291452241561 time 291403570883 state 0x2 ref 0 00000001:00080000:2.0:1789760687.366718:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:2.0:1789760687.366743:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000100:00100000:3.0:1789760687.384076:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760687.384186:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863102848 00000100:00100000:0.0:1789760687.384196:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863102848 00000100:00100000:0.0:1789760687.384261:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 291452241561 time 291403570883 state 0x0 ref 1 00000100:00100000:0.0:1789760687.384274:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 291603570883 time 291403570883 state 0x1 ref 1 00000100:00100000:0.0:1789760687.491019:0:11797:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 291603570883 time 291604204310 state 0x0 ref 1 00000100:00100000:0.0:1789760687.491054:0:11797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14347d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863102848:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760687.491612:0:11797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 2097152, mtime: 0x6aad94ae, atime: 0x6aad94ae, ctime: 0x6aad94ae, blocks: 0x1007 00010000:00010000:0.0:1789760687.491621:0:11797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059a05cf5/0x3e099f5ef04ae24e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.491636:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=291s v=(0 0) 00010000:00010000:0.0:1789760687.491641:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760687.491647:0:11797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059a05cf5/0x3e099f5ef04ae24e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760687.491662:0:11797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059a05cf5/0x3e099f5ef04ae24e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760687.565166:0:11797:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:2.0:1789760687.565175:0:11797:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:2.0:1789760687.565191:0:11797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059a05cf5/0x3e099f5ef04ae24e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.565203:0:11797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059a05cf5/0x3e099f5ef04ae24e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.565211:0:11797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059a05cf5/0x3e099f5ef04ae24e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.565219:0:11797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760687.565238:0:11797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059a05cf5/0x3e099f5ef04ae24e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.565248:0:11797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059a05cf5/0x3e099f5ef04ae24e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.565267:0:11797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059a05cf5/0x3e099f5ef04ae24e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.565275:0:11797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059a05cf5/0x3e099f5ef04ae24e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760687.565370:0:11797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14347d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+7:2348:x1876699863102848:12345-192.168.203.12@tcp:4:dd.500 Request processed in 74329us (181298us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1789760687.565380:0:11797:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:2.0:1789760687.565389:0:11797:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 291603570883 time 291604204310 state 0x2 ref 0 00000001:00080000:2.0:1789760687.565426:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967326 is committed 00000100:00100000:3.0:1789760687.573450:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760687.573556:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863102976 00000100:00100000:0.0:1789760687.573566:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863102976 00000100:00100000:0.0:1789760687.573618:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 291603570883 time 291604204310 state 0x0 ref 1 00000100:00100000:0.0:1789760687.573629:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 291804204310 time 291604204310 state 0x1 ref 1 00000100:00100000:2.0:1789760687.691747:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 291804204310 time 291804933309 state 0x0 ref 1 00000100:00100000:2.0:1789760687.691779:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14347ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863102976:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760687.691871:0:11798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 3145728, mtime: 0x6aad94ae, atime: 0x6aad94ae, ctime: 0x6aad94ae, blocks: 0x1807 00010000:00010000:2.0:1789760687.691878:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae255 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.691890:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=291s v=(0 0) 00010000:00010000:2.0:1789760687.691893:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760687.691908:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae255 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.691919:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae255 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760687.732072:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760687.735340:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863103104 00000100:00100000:3.0:1789760687.735354:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863103104 00000100:00100000:3.0:1789760687.735455:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 253 00000100:00100000:3.0:1789760687.735466:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25860b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2348:x1876699863103104:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760687.735548:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25860b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2348:x1876699863103104:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 84us (3485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760687.735556:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 253 00000100:00100000:0.0:1789760687.743742:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760687.743837:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760687.744066:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863103360 00000100:00100000:0.0:1789760687.744076:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863103360 00000100:00100000:0.0:1789760687.744138:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 105 00000100:00100000:0.0:1789760687.744148:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2349:x1876699863103360:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1789760687.744222:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2349:x1876699863103360:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 75us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760687.744266:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863103232 00000100:00100000:2.0:1789760687.744270:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863103232 00000100:00100000:2.0:1789760687.744303:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:2.0:1789760687.744310:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863103232:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1789760687.744340:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863103232:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 31us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760687.744347:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:0.0:1789760687.744400:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 105 00000100:00080000:0.0:1789760687.744420:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789760687.744424:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789760687.770973:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967327 is committed 00002000:00010000:1.0:1789760687.772266:0:11798:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:1.0:1789760687.772274:0:11798:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1789760687.772289:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae255 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.772331:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae255 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.772340:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae255 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.772347:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b9e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760687.772352:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae255 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.772361:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae255 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.772379:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae255 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.772387:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae255 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760687.773102:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14347ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863102976:12345-192.168.203.12@tcp:4:dd.500 Request processed in 81331us (199652us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1789760687.773114:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:1.0:1789760687.773122:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 291804204310 time 291804933309 state 0x2 ref 0 00000100:00100000:0.0:1789760687.779904:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760687.780148:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863103488 00000100:00100000:2.0:1789760687.780167:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863103488 00000100:00100000:2.0:1789760687.780223:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 291804204310 time 291804933309 state 0x0 ref 1 00000100:00100000:2.0:1789760687.780236:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 292004933309 time 291804933309 state 0x1 ref 1 00000100:00100000:1.0:1789760687.891887:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 292004933309 time 292005073595 state 0x0 ref 1 00000100:00100000:1.0:1789760687.891936:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863103488:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760687.891989:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 4194304, mtime: 0x6aad94ae, atime: 0x6aad94ae, ctime: 0x6aad94ae, blocks: 0x2007 00010000:00010000:1.0:1789760687.891999:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae25c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.892014:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=292s v=(0 0) 00010000:00010000:1.0:1789760687.892018:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760687.892024:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae25c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760687.892038:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae25c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760687.973065:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967328 is committed 00002000:00010000:2.0:1789760687.973136:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:2.0:1789760687.973141:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789760686 -> 1789760687 00002000:00010000:2.0:1789760687.973144:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789760686 -> 1789760687 00002000:00010000:2.0:1789760687.973146:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:2.0:1789760687.973161:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae25c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.973184:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae25c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.973225:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae25c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.973233:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760687.973239:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae25c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.973249:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae25c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.973270:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae25c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760687.973279:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae25c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760687.973384:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863103488:12345-192.168.203.12@tcp:4:dd.500 Request processed in 81457us (193485us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1789760687.973396:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:2.0:1789760687.973404:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 292004933309 time 292005073595 state 0x2 ref 0 00000100:00100000:2.0:1789760687.980068:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760687.980166:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863103616 00000100:00100000:1.0:1789760687.980186:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863103616 00000100:00100000:1.0:1789760687.980256:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 292004933309 time 292005073595 state 0x0 ref 1 00000100:00100000:1.0:1789760687.980270:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 292205073595 time 292005073595 state 0x1 ref 1 00000100:00100000:2.0:1789760688.096078:0:11797:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 292205073595 time 292209263967 state 0x0 ref 1 00000100:00100000:2.0:1789760688.096113:0:11797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df142e40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863103616:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760688.096196:0:11797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 5242880, mtime: 0x6aad94af, atime: 0x6aad94ae, ctime: 0x6aad94af, blocks: 0x2807 00010000:00010000:2.0:1789760688.096206:0:11797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a4e18fa/0x3e099f5ef04ae263 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.096221:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=292s v=(0 0) 00010000:00010000:2.0:1789760688.096225:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760688.096231:0:11797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a4e18fa/0x3e099f5ef04ae263 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.096244:0:11797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a4e18fa/0x3e099f5ef04ae263 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760688.142412:0:11797:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:2.0:1789760688.142421:0:11797:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:2.0:1789760688.142434:0:11797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a4e18fa/0x3e099f5ef04ae263 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.142447:0:11797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a4e18fa/0x3e099f5ef04ae263 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.142457:0:11797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a4e18fa/0x3e099f5ef04ae263 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.142464:0:11797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b9000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760688.142469:0:11797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a4e18fa/0x3e099f5ef04ae263 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.142497:0:11797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a4e18fa/0x3e099f5ef04ae263 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.142515:0:11797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a4e18fa/0x3e099f5ef04ae263 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.142522:0:11797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a4e18fa/0x3e099f5ef04ae263 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760688.142656:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967329 is committed 00000100:00100000:2.0:1789760688.142703:0:11797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df142e40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863103616:12345-192.168.203.12@tcp:4:dd.500 Request processed in 46602us (162640us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1789760688.142712:0:11797:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:2.0:1789760688.142719:0:11797:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 292205073595 time 292209263967 state 0x2 ref 0 00000100:00100000:0.0:1789760688.147230:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760688.147301:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863103744 00000100:00100000:2.0:1789760688.147311:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863103744 00000100:00100000:2.0:1789760688.147363:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 292205073595 time 292209263967 state 0x0 ref 1 00000100:00100000:2.0:1789760688.147376:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 292409263967 time 292209263967 state 0x1 ref 1 00000100:00100000:1.0:1789760688.296401:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 292409263967 time 292409579312 state 0x0 ref 1 00000100:00100000:1.0:1789760688.296470:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863103744:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760688.296572:0:11798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 6291456, mtime: 0x6aad94af, atime: 0x6aad94ae, ctime: 0x6aad94af, blocks: 0x3007 00010000:00010000:1.0:1789760688.296584:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae26a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760688.296647:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=292s v=(0 0) 00010000:00010000:1.0:1789760688.296671:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760688.296679:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae26a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760688.296697:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae26a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760688.342114:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789760688.382024:0:11798:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:2.0:1789760688.382039:0:11798:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:2.0:1789760688.382059:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae26a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.382084:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae26a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.382125:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae26a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.382134:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760688.382139:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae26a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.382150:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae26a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.382173:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae26a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.382182:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae26a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760688.382316:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+7:2350:x1876699863103744:12345-192.168.203.12@tcp:4:dd.500 Request processed in 85886us (235087us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1789760688.382329:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:2.0:1789760688.382339:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 292409263967 time 292409579312 state 0x2 ref 0 00000001:00080000:3.0:1789760688.383359:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967330 is committed 00000100:00100000:1.0:1789760688.387446:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760688.387656:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863103872 00000100:00100000:2.0:1789760688.387665:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863103872 00000100:00100000:2.0:1789760688.387718:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 292409263967 time 292409579312 state 0x0 ref 1 00000100:00100000:2.0:1789760688.387739:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 292609579312 time 292409579312 state 0x1 ref 1 00000100:00100000:2.0:1789760688.497409:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 292609579312 time 292610594589 state 0x0 ref 1 00000100:00100000:2.0:1789760688.497444:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863103872:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760688.497508:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 7340032, mtime: 0x6aad94af, atime: 0x6aad94ae, ctime: 0x6aad94af, blocks: 0x3807 00010000:00010000:2.0:1789760688.497517:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae271 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.497542:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=292s v=(0 0) 00010000:00010000:2.0:1789760688.497547:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760688.497554:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae271 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.497569:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae271 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760688.598605:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967331 is committed 00002000:00010000:2.0:1789760688.599256:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 7340032 -> 8388608 00002000:00010000:2.0:1789760688.599263:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1789760688.599278:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae271 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.599291:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae271 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.599299:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae271 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.599326:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b9e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760688.599331:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae271 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.599341:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae271 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.599360:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae271 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.599368:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae271 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760688.599469:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863103872:12345-192.168.203.12@tcp:4:dd.500 Request processed in 102039us (212027us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789760688.599480:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:2.0:1789760688.599487:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 292609579312 time 292610594589 state 0x2 ref 0 00000100:00100000:1.0:1789760688.609101:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760688.610036:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863104000 00000100:00100000:2.0:1789760688.610051:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863104000 00000100:00100000:2.0:1789760688.610110:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 292609579312 time 292610594589 state 0x0 ref 1 00000100:00100000:2.0:1789760688.610122:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 292810594589 time 292610594589 state 0x1 ref 1 00000100:00100000:2.0:1789760688.697534:0:11797:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 292810594589 time 292810708082 state 0x0 ref 1 00000100:00100000:2.0:1789760688.697568:0:11797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863104000:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760688.697643:0:11797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 8388608, mtime: 0x6aad94af, atime: 0x6aad94ae, ctime: 0x6aad94af, blocks: 0x4007 00010000:00010000:2.0:1789760688.697654:0:11797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae278 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.697671:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=292s v=(0 0) 00010000:00010000:2.0:1789760688.697676:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760688.697682:0:11797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae278 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.697696:0:11797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae278 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760688.719066:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14347c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883039232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760688.719290:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760688.719511:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883039232 00000100:00100000:1.0:1789760688.719523:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883039232 00000100:00100000:1.0:1789760688.719597:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789760688.719609:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df142e40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883039232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789760688.719640:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 88539136 pending 1703936 free 3859808256 avail 3832545280 00000004:00080000:3.0:1789760688.719796:0:6760:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 292832992754ns, next at 293832990301ns, rc = 0 00000100:00100000:1.0:1789760688.723217:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df142e40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883039232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3594us (4035us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760688.723241:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789760688.723499:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1789760688.723508:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df144605880, transno 4294967324 00000100:00100000:2.0:1789760688.723581:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14347c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883039232:0@lo:13:osp-pre-0-0.0 00002000:00010000:2.0:1789760688.794685:0:11797:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 8388608 -> 9437184 00002000:00010000:2.0:1789760688.794698:0:11797:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 16391 -> 18439 00010000:00010000:2.0:1789760688.794715:0:11797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae278 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.794740:0:11797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae278 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.794750:0:11797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae278 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.794777:0:11797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b9e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760688.794783:0:11797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae278 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.794793:0:11797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae278 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.794870:0:11797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae278 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.794880:0:11797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae278 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760688.795003:0:11797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+7:2351:x1876699863104000:12345-192.168.203.12@tcp:4:dd.500 Request processed in 97443us (185909us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1789760688.795015:0:11797:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:2.0:1789760688.795025:0:11797:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 292810594589 time 292810708082 state 0x2 ref 0 00000001:00080000:0.0:1789760688.795181:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967332 is committed 00000100:00100000:1.0:1789760688.816936:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760688.817058:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863104128 00000100:00100000:2.0:1789760688.817072:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863104128 00000100:00100000:2.0:1789760688.817153:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 292810594589 time 292810708082 state 0x0 ref 1 00000100:00100000:2.0:1789760688.817168:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 293010708082 time 292810708082 state 0x1 ref 1 00000100:00100000:2.0:1789760688.898956:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 293010708082 time 293012134244 state 0x0 ref 1 00000100:00100000:2.0:1789760688.899014:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863104128:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760688.899099:0:11798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 9437184, mtime: 0x6aad94af, atime: 0x6aad94ae, ctime: 0x6aad94af, blocks: 0x4807 00010000:00010000:2.0:1789760688.899108:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae27f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.899124:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=293s v=(0 0) 00010000:00010000:2.0:1789760688.899129:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760688.899136:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae27f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.899153:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae27f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760688.998557:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967333 is committed 00002000:00010000:2.0:1789760688.998626:0:11798:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 9437184 -> 10485760 00002000:00010000:2.0:1789760688.998630:0:11798:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789760687 -> 1789760688 00002000:00010000:2.0:1789760688.998633:0:11798:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789760687 -> 1789760688 00002000:00010000:2.0:1789760688.998635:0:11798:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 18439 -> 20487 00010000:00010000:2.0:1789760688.998651:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae27f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.998664:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae27f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.998672:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae27f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.998679:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b9e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760688.998698:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae27f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.998707:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae27f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.998738:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae27f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760688.998746:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae27f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760688.998879:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863104128:12345-192.168.203.12@tcp:4:dd.500 Request processed in 99879us (181955us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1789760688.998889:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:2.0:1789760688.998897:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 293010708082 time 293012134244 state 0x2 ref 0 00000100:00100000:0.0:1789760689.013575:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760689.013675:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863104256 00000100:00100000:2.0:1789760689.013686:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863104256 00000100:00100000:2.0:1789760689.013776:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 293010708082 time 293012134244 state 0x0 ref 1 00000100:00100000:2.0:1789760689.013789:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 293212134244 time 293012134244 state 0x1 ref 1 00000100:00080000:0.0:1789760689.014280:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760689.099116:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 293212134244 time 293212301257 state 0x0 ref 1 00000100:00100000:2.0:1789760689.099157:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863104256:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760689.099231:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 10485760, mtime: 0x6aad94b0, atime: 0x6aad94ae, ctime: 0x6aad94b0, blocks: 0x5007 00010000:00010000:2.0:1789760689.099240:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae286 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760689.099272:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=293s v=(0 0) 00010000:00010000:2.0:1789760689.099277:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760689.099283:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae286 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760689.099297:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae286 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760689.164540:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967334 is committed 00002000:00010000:1.0:1789760689.164658:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 10485760 -> 11534336 00002000:00010000:1.0:1789760689.164665:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 20487 -> 22535 00010000:00010000:1.0:1789760689.164684:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae286 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760689.164697:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae286 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760689.164738:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae286 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760689.164747:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b9e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760689.164753:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae286 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760689.164763:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae286 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760689.164882:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae286 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760689.164891:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee1e7128/0x3e099f5ef04ae286 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760689.165026:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863104256:12345-192.168.203.12@tcp:4:dd.500 Request processed in 65883us (151453us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1789760689.165039:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:1.0:1789760689.165049:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 293212134244 time 293212301257 state 0x2 ref 0 00000100:00100000:2.0:1789760689.177416:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760689.178320:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863104384 00000100:00100000:1.0:1789760689.178338:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863104384 00000100:00100000:1.0:1789760689.178400:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 293212134244 time 293212301257 state 0x0 ref 1 00000100:00100000:1.0:1789760689.178413:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 293412301257 time 293212301257 state 0x1 ref 1 00000100:00100000:2.0:1789760689.299279:0:11797:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 293412301257 time 293412463553 state 0x0 ref 1 00000100:00100000:2.0:1789760689.299315:0:11797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df142e42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863104384:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760689.299373:0:11797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 11534336, mtime: 0x6aad94b0, atime: 0x6aad94ae, ctime: 0x6aad94b0, blocks: 0x5807 00010000:00010000:2.0:1789760689.299383:0:11797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae28d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760689.299408:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=293s v=(0 0) 00010000:00010000:2.0:1789760689.299413:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760689.299419:0:11797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae28d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760689.299433:0:11797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae28d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760689.359549:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789760689.404636:0:11797:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 11534336 -> 12582912 00002000:00010000:2.0:1789760689.404652:0:11797:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 22535 -> 24583 00010000:00010000:2.0:1789760689.404673:0:11797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae28d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760689.404874:0:11797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae28d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760689.404888:0:11797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae28d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760689.404896:0:11797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b8400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760689.404902:0:11797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae28d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760689.404913:0:11797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae28d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760689.404953:0:11797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae28d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760689.404962:0:11797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae28d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760689.405090:0:11797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df142e42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+7:2351:x1876699863104384:12345-192.168.203.12@tcp:4:dd.500 Request processed in 105784us (227684us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789760689.405123:0:11797:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:2.0:1789760689.405134:0:11797:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 293412301257 time 293412463553 state 0x2 ref 0 00000001:00080000:2.0:1789760689.405189:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967335 is committed 00000100:00100000:1.0:1789760689.414734:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760689.414888:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863104512 00000100:00100000:2.0:1789760689.414906:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863104512 00000100:00100000:2.0:1789760689.414989:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 293412301257 time 293412463553 state 0x0 ref 1 00000100:00100000:2.0:1789760689.415006:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 293612463553 time 293412463553 state 0x1 ref 1 00000100:00100000:2.0:1789760689.499414:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 293612463553 time 293612599207 state 0x0 ref 1 00000100:00100000:2.0:1789760689.499448:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863104512:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760689.499509:0:11798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 12582912, mtime: 0x6aad94b0, atime: 0x6aad94ae, ctime: 0x6aad94b0, blocks: 0x6007 00010000:00010000:2.0:1789760689.499522:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae294 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760689.499539:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=293s v=(0 0) 00010000:00010000:2.0:1789760689.499544:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760689.499565:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae294 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760689.499580:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae294 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760689.621482:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967336 is committed 00002000:00010000:2.0:1789760689.621588:0:11798:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 12582912 -> 13631488 00002000:00010000:2.0:1789760689.621593:0:11798:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 24583 -> 26631 00010000:00010000:2.0:1789760689.621622:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae294 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760689.621633:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae294 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760689.621641:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae294 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760689.621648:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b8400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760689.621652:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae294 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760689.621660:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae294 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760689.621678:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae294 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760689.621686:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae294 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760689.621792:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863104512:12345-192.168.203.12@tcp:4:dd.500 Request processed in 122355us (207076us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1789760689.621838:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:2.0:1789760689.621847:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 293612463553 time 293612599207 state 0x2 ref 0 00000100:00100000:2.0:1789760689.634422:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760689.634591:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863104640 00000100:00100000:0.0:1789760689.634603:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863104640 00000100:00100000:0.0:1789760689.634660:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 293612463553 time 293612599207 state 0x0 ref 1 00000100:00100000:0.0:1789760689.634672:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 293812599207 time 293612599207 state 0x1 ref 1 00000100:00100000:1.0:1789760689.706115:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 293812599207 time 293815996266 state 0x0 ref 1 00000100:00100000:1.0:1789760689.706158:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df142e40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863104640:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760689.706219:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13631488, mtime: 0x6aad94b0, atime: 0x6aad94ae, ctime: 0x6aad94b0, blocks: 0x6807 00010000:00010000:1.0:1789760689.706229:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007914533c/0x3e099f5ef04ae29b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760689.706245:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=293s v=(0 0) 00010000:00010000:1.0:1789760689.706250:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760689.706255:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007914533c/0x3e099f5ef04ae29b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760689.706269:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007914533c/0x3e099f5ef04ae29b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760689.792056:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13631488 -> 14680064 00002000:00010000:0.0:1789760689.792066:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789760688 -> 1789760689 00002000:00010000:0.0:1789760689.792084:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789760688 -> 1789760689 00002000:00010000:0.0:1789760689.792087:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 26631 -> 28679 00010000:00010000:0.0:1789760689.792103:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007914533c/0x3e099f5ef04ae29b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760689.792116:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007914533c/0x3e099f5ef04ae29b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760689.792125:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007914533c/0x3e099f5ef04ae29b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760689.792133:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760689.792138:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007914533c/0x3e099f5ef04ae29b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760689.792157:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007914533c/0x3e099f5ef04ae29b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760689.792180:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007914533c/0x3e099f5ef04ae29b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760689.792187:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007914533c/0x3e099f5ef04ae29b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760689.792299:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df142e40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+7:2348:x1876699863104640:12345-192.168.203.12@tcp:4:dd.500 Request processed in 86157us (157882us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1789760689.792310:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:0.0:1789760689.792324:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 293812599207 time 293815996266 state 0x2 ref 0 00000001:00080000:2.0:1789760689.797998:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967337 is committed 00000100:00100000:2.0:1789760689.800574:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760689.800682:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863104768 00000100:00100000:1.0:1789760689.800693:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863104768 00000100:00100000:1.0:1789760689.800770:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 293812599207 time 293815996266 state 0x0 ref 1 00000100:00100000:1.0:1789760689.800786:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 294015996266 time 293815996266 state 0x1 ref 1 00000100:00100000:2.0:1789760689.903062:0:11797:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 294015996266 time 294016247845 state 0x0 ref 1 00000100:00100000:2.0:1789760689.903098:0:11797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df142e43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863104768:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760689.903168:0:11797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 14680064, mtime: 0x6aad94b1, atime: 0x6aad94ae, ctime: 0x6aad94b1, blocks: 0x7007 00010000:00010000:2.0:1789760689.903178:0:11797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae2a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760689.903204:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=294s v=(0 0) 00010000:00010000:2.0:1789760689.903209:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760689.903216:0:11797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae2a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760689.903232:0:11797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae2a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760690.002769:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967338 is committed 00002000:00010000:2.0:1789760690.003855:0:11797:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 14680064 -> 15728640 00002000:00010000:2.0:1789760690.003863:0:11797:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 28679 -> 30727 00010000:00010000:2.0:1789760690.003877:0:11797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae2a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760690.003891:0:11797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae2a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760690.003899:0:11797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae2a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760690.003944:0:11797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b9200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760690.003950:0:11797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae2a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760690.003960:0:11797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae2a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760690.003982:0:11797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae2a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760690.003989:0:11797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae2a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760690.004095:0:11797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df142e43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863104768:12345-192.168.203.12@tcp:4:dd.500 Request processed in 101010us (203531us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1789760690.004753:0:11797:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:2.0:1789760690.004762:0:11797:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 294015996266 time 294016247845 state 0x2 ref 0 00000100:00100000:1.0:1789760690.015530:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760690.015707:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863104896 00000100:00100000:2.0:1789760690.015728:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863104896 00000100:00100000:2.0:1789760690.015788:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 294015996266 time 294016247845 state 0x0 ref 1 00000100:00100000:2.0:1789760690.015822:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 294216247845 time 294016247845 state 0x1 ref 1 00000100:00100000:2.0:1789760690.103220:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 294216247845 time 294216405292 state 0x0 ref 1 00000100:00100000:2.0:1789760690.103253:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863104896:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760690.103331:0:11798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 15728640, mtime: 0x6aad94b1, atime: 0x6aad94ae, ctime: 0x6aad94b1, blocks: 0x7807 00010000:00010000:2.0:1789760690.103342:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae2a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760690.103358:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=294s v=(0 0) 00010000:00010000:2.0:1789760690.103363:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760690.103369:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae2a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760690.103396:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae2a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760690.195572:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967339 is committed 00002000:00010000:2.0:1789760690.195750:0:11798:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 15728640 -> 16777216 00002000:00010000:2.0:1789760690.195755:0:11798:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 30727 -> 32775 00010000:00010000:2.0:1789760690.195768:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae2a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760690.195779:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae2a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760690.195789:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae2a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760690.195796:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b9200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760690.195834:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae2a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760690.195862:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae2a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760690.195884:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae2a9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760690.195891:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae2a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760690.196008:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863104896:12345-192.168.203.12@tcp:4:dd.500 Request processed in 92765us (180483us total) trans 4294967339 rc 0/0 00000100:00100000:2.0:1789760690.196019:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:2.0:1789760690.196027:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 294216247845 time 294216405292 state 0x2 ref 0 00000100:00100000:0.0:1789760690.208419:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760690.208726:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863105024 00000100:00100000:3.0:1789760690.208736:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863105024 00000100:00100000:3.0:1789760690.208799:0:11799:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 294216247845 time 294216405292 state 0x0 ref 1 00000100:00100000:3.0:1789760690.208847:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 294416405292 time 294216405292 state 0x1 ref 1 00000100:00100000:1.0:1789760690.255989:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df142e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876699883039488:0@lo:400:kworker.0 00000100:00100000:1.0:1789760690.256062:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760690.256129:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df142e43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883040000:0@lo:400:kworker.0 00000100:00100000:1.0:1789760690.256170:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760690.256205:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789760690.256211:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df142e41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883039616:0@lo:400:kworker.0 00000100:00100000:1.0:1789760690.256232:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760690.256260:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883040000 00000100:00100000:1.0:1789760690.256267:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883040000 00000100:00100000:1.0:1789760690.256318:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789760690.256327:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1876699883040000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760690.256375:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1876699883040000:12345-0@lo:400:kworker.0 Request processed in 49us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760690.256848:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df142e41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699883039360:0@lo:400:kworker.0 00000100:00100000:3.0:1789760690.256885:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760690.256919:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df142e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1876699883039872:0@lo:400:kworker.0 00000100:00100000:3.0:1789760690.257481:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760690.257507:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789760690.257514:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df142e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883039744:0@lo:400:kworker.0 00000100:00100000:3.0:1789760690.257537:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760690.257577:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883039744 00000100:00100000:3.0:1789760690.257581:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883039744 00000100:00100000:3.0:1789760690.257620:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789760690.257628:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14347fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883039744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760690.257670:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14347fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883039744:12345-0@lo:400:kworker.0 Request processed in 43us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760690.257678:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789760690.257721:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883039360 00000100:00100000:3.0:1789760690.257726:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883039360 00000100:00100000:3.0:1789760690.257750:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789760690.257756:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3311:x1876699883039360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760690.257785:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3311:x1876699883039360:12345-0@lo:400:kworker.0 Request processed in 30us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760690.257791:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789760690.257898:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883039488 00000100:00100000:2.0:1789760690.257903:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883039488 00000100:00100000:2.0:1789760690.258009:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883039616 00000100:00100000:2.0:1789760690.258013:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883039616 00000100:00100000:2.0:1789760690.258028:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883039872 00000100:00100000:2.0:1789760690.258030:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883039872 00000100:00100000:2.0:1789760690.258046:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789760690.258052:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876699883039488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760690.258089:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876699883039488:12345-0@lo:400:kworker.0 Request processed in 38us (2027us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760690.258095:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789760690.258107:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789760690.258125:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883039616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760690.258153:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883039616:12345-0@lo:400:kworker.0 Request processed in 29us (1920us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760690.258158:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789760690.258169:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789760690.258175:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14347f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876699883039872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760690.258200:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14347f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876699883039872:12345-0@lo:400:kworker.0 Request processed in 26us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760690.258206:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789760690.258278:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df142e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883039744:0@lo:400:kworker.0 00000100:00100000:2.0:1789760690.258288:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df142e41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699883039360:0@lo:400:kworker.0 00000100:00100000:2.0:1789760690.258297:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df142e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1876699883039872:0@lo:400:kworker.0 00000100:00080000:2.0:1789760690.258356:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789760690.258360:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789760690.258362:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789760690.258498:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789760690.258532:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df142e41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883039616:0@lo:400:kworker.0 00000100:00100000:1.0:1789760690.258544:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df142e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876699883039488:0@lo:400:kworker.0 00000100:00100000:1.0:1789760690.258553:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:1.0:1789760690.258558:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df27cae1880, transno 4294967302 00000100:00100000:1.0:1789760690.258572:0:3308:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8df144606680 x1876699883038080/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789760703 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760690.258582:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df142e43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883040000:0@lo:400:kworker.0 00000100:00100000:0.0:1789760690.303376:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 294416405292 time 294416560532 state 0x0 ref 1 00000100:00100000:0.0:1789760690.303408:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863105024:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760690.303461:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 16777216, mtime: 0x6aad94b1, atime: 0x6aad94ae, ctime: 0x6aad94b1, blocks: 0x8007 00010000:00010000:0.0:1789760690.303470:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd1290d9/0x3e099f5ef04ae2b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760690.303487:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=294s v=(0 0) 00010000:00010000:0.0:1789760690.303492:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760690.303498:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd1290d9/0x3e099f5ef04ae2b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760690.303512:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd1290d9/0x3e099f5ef04ae2b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760690.376196:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967340 is committed 00002000:00010000:3.0:1789760690.376299:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 16777216 -> 17825792 00002000:00010000:3.0:1789760690.376304:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 32775 -> 34823 00010000:00010000:3.0:1789760690.376331:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd1290d9/0x3e099f5ef04ae2b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760690.376343:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd1290d9/0x3e099f5ef04ae2b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760690.376352:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd1290d9/0x3e099f5ef04ae2b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760690.376359:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760690.376374:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd1290d9/0x3e099f5ef04ae2b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760690.376384:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd1290d9/0x3e099f5ef04ae2b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760690.376403:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd1290d9/0x3e099f5ef04ae2b0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760690.376410:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd1290d9/0x3e099f5ef04ae2b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760690.376501:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863105024:12345-192.168.203.12@tcp:4:dd.500 Request processed in 73103us (168088us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1789760690.376511:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:3.0:1789760690.376519:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 294416405292 time 294416560532 state 0x2 ref 0 00010000:00010000:3.0:1789760690.384395:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760690.384596:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760690.385299:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863105152 00000100:00100000:1.0:1789760690.385310:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863105152 00000100:00100000:1.0:1789760690.385376:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 294416405292 time 294416560532 state 0x0 ref 1 00000100:00100000:1.0:1789760690.385390:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 294616560532 time 294416560532 state 0x1 ref 1 00000100:00100000:2.0:1789760690.503608:0:11797:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 294616560532 time 294616791520 state 0x0 ref 1 00000100:00100000:2.0:1789760690.503649:0:11797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863105152:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760690.503971:0:11797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 17825792, mtime: 0x6aad94b1, atime: 0x6aad94ae, ctime: 0x6aad94b1, blocks: 0x8807 00010000:00010000:2.0:1789760690.503980:0:11797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c430fb76/0x3e099f5ef04ae2b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760690.503997:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=294s v=(0 0) 00010000:00010000:2.0:1789760690.504002:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760690.504008:0:11797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c430fb76/0x3e099f5ef04ae2b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760690.504038:0:11797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c430fb76/0x3e099f5ef04ae2b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760690.580265:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967341 is committed 00002000:00010000:3.0:1789760690.582258:0:11797:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 17825792 -> 18874368 00002000:00010000:3.0:1789760690.582267:0:11797:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 34823 -> 36871 00010000:00010000:3.0:1789760690.582282:0:11797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c430fb76/0x3e099f5ef04ae2b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760690.582296:0:11797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c430fb76/0x3e099f5ef04ae2b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760690.582305:0:11797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c430fb76/0x3e099f5ef04ae2b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760690.582313:0:11797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b9600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760690.582318:0:11797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c430fb76/0x3e099f5ef04ae2b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760690.582327:0:11797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c430fb76/0x3e099f5ef04ae2b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760690.582347:0:11797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c430fb76/0x3e099f5ef04ae2b7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760690.582354:0:11797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c430fb76/0x3e099f5ef04ae2b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760690.582463:0:11797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863105152:12345-192.168.203.12@tcp:4:dd.500 Request processed in 78831us (197868us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1789760690.582475:0:11797:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:3.0:1789760690.582505:0:11797:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 294616560532 time 294616791520 state 0x2 ref 0 00000100:00100000:0.0:1789760690.607106:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760690.607276:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863105280 00000100:00100000:2.0:1789760690.607286:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863105280 00000100:00100000:2.0:1789760690.607344:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 294616560532 time 294616791520 state 0x0 ref 1 00000100:00100000:2.0:1789760690.607356:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 294816791520 time 294616791520 state 0x1 ref 1 00000100:00100000:2.0:1789760690.703737:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 294816791520 time 294816922943 state 0x0 ref 1 00000100:00100000:2.0:1789760690.703779:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863105280:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760690.703888:0:11798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 18874368, mtime: 0x6aad94b1, atime: 0x6aad94ae, ctime: 0x6aad94b1, blocks: 0x9007 00010000:00010000:2.0:1789760690.703897:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004551dd5d/0x3e099f5ef04ae2be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760690.703914:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=294s v=(0 0) 00010000:00010000:2.0:1789760690.703918:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760690.704123:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004551dd5d/0x3e099f5ef04ae2be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760690.704200:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004551dd5d/0x3e099f5ef04ae2be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789760690.772271:0:7838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 294885466522ns, next at 295885464442ns, rc = 0 00000100:00100000:2.0:1789760690.772316:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789760690.772341:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14347e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883040128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760690.772419:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760690.773080:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883040128 00000100:00100000:0.0:1789760690.773099:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883040128 00000100:00100000:0.0:1789760690.773152:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789760690.773161:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df142e40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876699883040128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789760690.773195:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 71499776 pending 0 free 3843031040 avail 3840933888 00000100:00100000:0.0:1789760690.773258:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df142e40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876699883040128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760690.773265:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789760690.773938:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14347e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883040128:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1789760690.830322:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967342 is committed 00002000:00010000:2.0:1789760690.830751:0:11798:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 18874368 -> 19922944 00002000:00010000:2.0:1789760690.830756:0:11798:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 36871 -> 38919 00010000:00010000:2.0:1789760690.830771:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004551dd5d/0x3e099f5ef04ae2be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760690.830784:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004551dd5d/0x3e099f5ef04ae2be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760690.830793:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004551dd5d/0x3e099f5ef04ae2be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760690.830819:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b8600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760690.830825:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004551dd5d/0x3e099f5ef04ae2be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760690.830834:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004551dd5d/0x3e099f5ef04ae2be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760690.830855:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004551dd5d/0x3e099f5ef04ae2be lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760690.830863:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004551dd5d/0x3e099f5ef04ae2be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760690.830967:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863105280:12345-192.168.203.12@tcp:4:dd.500 Request processed in 127208us (224045us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1789760690.830995:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:2.0:1789760690.831003:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 294816791520 time 294816922943 state 0x2 ref 0 00000100:00100000:1.0:1789760690.851374:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760690.851606:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863105408 00000100:00100000:3.0:1789760690.851615:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863105408 00000100:00100000:3.0:1789760690.851670:0:11799:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 294816791520 time 294816922943 state 0x0 ref 1 00000100:00100000:3.0:1789760690.851683:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 295016922943 time 294816922943 state 0x1 ref 1 00000100:00100000:3.0:1789760690.906740:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 295016922943 time 295019925250 state 0x0 ref 1 00000100:00100000:3.0:1789760690.906772:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863105408:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760690.906874:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 19922944, mtime: 0x6aad94b1, atime: 0x6aad94ae, ctime: 0x6aad94b1, blocks: 0x9807 00010000:00010000:3.0:1789760690.906884:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2af73a2/0x3e099f5ef04ae2c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760690.906900:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=295s v=(0 0) 00010000:00010000:3.0:1789760690.906905:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760690.906911:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2af73a2/0x3e099f5ef04ae2c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760690.906936:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2af73a2/0x3e099f5ef04ae2c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760690.990421:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967343 is committed 00002000:00010000:0.0:1789760690.990536:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 19922944 -> 20971520 00002000:00010000:0.0:1789760690.990542:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789760689 -> 1789760690 00002000:00010000:0.0:1789760690.990544:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789760689 -> 1789760690 00002000:00010000:0.0:1789760690.990547:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 38919 -> 40967 00010000:00010000:0.0:1789760690.990562:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2af73a2/0x3e099f5ef04ae2c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760690.990574:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2af73a2/0x3e099f5ef04ae2c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760690.990583:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2af73a2/0x3e099f5ef04ae2c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760690.990590:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241675e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760690.990595:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2af73a2/0x3e099f5ef04ae2c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760690.990603:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2af73a2/0x3e099f5ef04ae2c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760690.990622:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2af73a2/0x3e099f5ef04ae2c5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760690.990642:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2af73a2/0x3e099f5ef04ae2c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760690.990872:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863105408:12345-192.168.203.12@tcp:4:dd.500 Request processed in 84110us (139502us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1789760690.990883:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:0.0:1789760690.990892:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 295016922943 time 295019925250 state 0x2 ref 0 00000100:00100000:0.0:1789760691.002302:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760691.002434:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863105536 00000100:00100000:2.0:1789760691.002447:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863105536 00000100:00100000:2.0:1789760691.002536:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 295016922943 time 295019925250 state 0x0 ref 1 00000100:00100000:2.0:1789760691.002550:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 295219925250 time 295019925250 state 0x1 ref 1 00000100:00080000:0.0:1789760691.002667:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760691.106994:0:11797:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 295219925250 time 295220179473 state 0x0 ref 1 00000100:00100000:3.0:1789760691.107028:0:11797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863105536:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760691.107103:0:11797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 20971520, mtime: 0x6aad94b2, atime: 0x6aad94ae, ctime: 0x6aad94b2, blocks: 0xa007 00010000:00010000:3.0:1789760691.107113:0:11797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae2cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760691.107131:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=295s v=(0 0) 00010000:00010000:3.0:1789760691.107135:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760691.107142:0:11797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae2cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760691.107156:0:11797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae2cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760691.217915:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967344 is committed 00002000:00010000:0.0:1789760691.218256:0:11797:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 20971520 -> 22020096 00002000:00010000:0.0:1789760691.218261:0:11797:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 40967 -> 43015 00010000:00010000:0.0:1789760691.218275:0:11797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae2cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760691.218288:0:11797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae2cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760691.218298:0:11797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae2cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760691.218305:0:11797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760691.218310:0:11797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae2cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760691.218319:0:11797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae2cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760691.218355:0:11797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae2cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760691.218363:0:11797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae2cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760691.218460:0:11797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863105536:12345-192.168.203.12@tcp:4:dd.500 Request processed in 111443us (216163us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1789760691.218471:0:11797:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:0.0:1789760691.218478:0:11797:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 295219925250 time 295220179473 state 0x2 ref 0 00000100:00100000:0.0:1789760691.237480:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760691.237618:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863105664 00000100:00100000:2.0:1789760691.237629:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863105664 00000100:00100000:2.0:1789760691.237683:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 295219925250 time 295220179473 state 0x0 ref 1 00000100:00100000:2.0:1789760691.237695:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 295420179473 time 295220179473 state 0x1 ref 1 00000100:00100000:2.0:1789760691.307758:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 295420179473 time 295420932497 state 0x0 ref 1 00000100:00100000:2.0:1789760691.307795:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863105664:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760691.311076:0:11798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 22020096, mtime: 0x6aad94b2, atime: 0x6aad94ae, ctime: 0x6aad94b2, blocks: 0xa807 00010000:00010000:3.0:1789760691.311101:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0a64689/0x3e099f5ef04ae2d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760691.311118:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=295s v=(0 0) 00010000:00010000:3.0:1789760691.311123:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760691.311190:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0a64689/0x3e099f5ef04ae2d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760691.311209:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0a64689/0x3e099f5ef04ae2d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760691.350647:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967345 is committed 00002000:00010000:0.0:1789760691.350786:0:11798:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 22020096 -> 23068672 00002000:00010000:0.0:1789760691.350791:0:11798:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 43015 -> 45063 00010000:00010000:0.0:1789760691.350826:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0a64689/0x3e099f5ef04ae2d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760691.350839:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0a64689/0x3e099f5ef04ae2d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760691.350849:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0a64689/0x3e099f5ef04ae2d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760691.350856:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241675c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760691.350861:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0a64689/0x3e099f5ef04ae2d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760691.350881:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0a64689/0x3e099f5ef04ae2d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760691.350900:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0a64689/0x3e099f5ef04ae2d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760691.350908:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0a64689/0x3e099f5ef04ae2d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760691.351004:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863105664:12345-192.168.203.12@tcp:4:dd.500 Request processed in 43219us (113529us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1789760691.351014:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:0.0:1789760691.351022:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 295420179473 time 295420932497 state 0x2 ref 0 00000100:00100000:1.0:1789760691.356426:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760691.356665:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863105792 00000100:00100000:3.0:1789760691.356675:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863105792 00000100:00100000:3.0:1789760691.356743:0:11799:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 295420179473 time 295420932497 state 0x0 ref 1 00000100:00100000:3.0:1789760691.356769:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 295620932497 time 295420932497 state 0x1 ref 1 00010000:00010000:1.0:1789760691.406998:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760691.507988:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 295620932497 time 295621174935 state 0x0 ref 1 00000100:00100000:0.0:1789760691.508020:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863105792:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760691.508077:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 23068672, mtime: 0x6aad94b2, atime: 0x6aad94ae, ctime: 0x6aad94b2, blocks: 0xb007 00010000:00010000:0.0:1789760691.508085:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae2da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760691.508102:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=295s v=(0 0) 00010000:00010000:0.0:1789760691.508106:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760691.508112:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae2da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760691.508143:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae2da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760691.562223:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967346 is committed 00002000:00010000:1.0:1789760691.562317:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 23068672 -> 24117248 00002000:00010000:1.0:1789760691.562322:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 45063 -> 47111 00010000:00010000:1.0:1789760691.562337:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae2da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760691.562350:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae2da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760691.562358:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae2da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760691.562365:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760691.562370:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae2da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760691.562379:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae2da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760691.562399:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae2da lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760691.562406:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae2da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760691.562507:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863105792:12345-192.168.203.12@tcp:4:dd.500 Request processed in 54498us (206086us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1789760691.562535:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:1.0:1789760691.562543:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 295620932497 time 295621174935 state 0x2 ref 0 00000100:00100000:2.0:1789760691.602825:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760691.603064:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863105920 00000100:00100000:0.0:1789760691.603075:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863105920 00000100:00100000:0.0:1789760691.603144:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 295620932497 time 295621174935 state 0x0 ref 1 00000100:00100000:0.0:1789760691.603158:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 295821174935 time 295621174935 state 0x1 ref 1 00000100:00100000:0.0:1789760691.708267:0:11797:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 295821174935 time 295821450911 state 0x0 ref 1 00000100:00100000:0.0:1789760691.708301:0:11797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df142e41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863105920:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760691.708363:0:11797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 24117248, mtime: 0x6aad94b2, atime: 0x6aad94ae, ctime: 0x6aad94b2, blocks: 0xb807 00010000:00010000:0.0:1789760691.708373:0:11797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae2e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760691.708389:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=295s v=(0 0) 00010000:00010000:0.0:1789760691.708393:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760691.708399:0:11797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae2e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760691.708413:0:11797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae2e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760691.761727:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967347 is committed 00002000:00010000:2.0:1789760691.761882:0:11797:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 24117248 -> 25165824 00002000:00010000:2.0:1789760691.761888:0:11797:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 47111 -> 49159 00010000:00010000:2.0:1789760691.761902:0:11797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae2e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760691.761914:0:11797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae2e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760691.761999:0:11797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae2e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760691.762007:0:11797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760691.762011:0:11797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae2e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760691.762020:0:11797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae2e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760691.762039:0:11797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae2e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760691.762046:0:11797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae2e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760691.762255:0:11797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df142e41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863105920:12345-192.168.203.12@tcp:4:dd.500 Request processed in 53965us (159449us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1789760691.762266:0:11797:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:2.0:1789760691.762275:0:11797:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 295821174935 time 295821450911 state 0x2 ref 0 00000100:00100000:2.0:1789760691.768063:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760691.768173:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863106048 00000100:00100000:0.0:1789760691.768183:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863106048 00000100:00100000:0.0:1789760691.768255:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 295821174935 time 295821450911 state 0x0 ref 1 00000100:00100000:0.0:1789760691.768268:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 296021450911 time 295821450911 state 0x1 ref 1 00000100:00100000:0.0:1789760691.909231:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 296021450911 time 296022416435 state 0x0 ref 1 00000100:00100000:0.0:1789760691.909265:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df142e42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863106048:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760691.909325:0:11798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 25165824, mtime: 0x6aad94b2, atime: 0x6aad94ae, ctime: 0x6aad94b2, blocks: 0xc007 00010000:00010000:0.0:1789760691.909334:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae2e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760691.909361:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=296s v=(0 0) 00010000:00010000:0.0:1789760691.909366:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760691.909371:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae2e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760691.909387:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae2e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760691.970485:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967348 is committed 00002000:00010000:3.0:1789760691.970493:0:11798:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 25165824 -> 26214400 00002000:00010000:3.0:1789760691.970499:0:11798:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789760690 -> 1789760691 00002000:00010000:3.0:1789760691.970502:0:11798:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789760690 -> 1789760691 00002000:00010000:3.0:1789760691.970505:0:11798:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 49159 -> 51207 00010000:00010000:3.0:1789760691.970518:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae2e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760691.970532:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae2e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760691.970542:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae2e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760691.970549:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760691.970554:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae2e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760691.970564:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae2e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760691.970583:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae2e8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760691.970591:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae2e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760691.970712:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df142e42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863106048:12345-192.168.203.12@tcp:4:dd.500 Request processed in 61446us (202642us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1789760691.970722:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:3.0:1789760691.970729:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 296021450911 time 296022416435 state 0x2 ref 0 00000100:00100000:2.0:1789760691.977554:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760691.977669:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863106176 00000100:00100000:0.0:1789760691.977678:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863106176 00000100:00100000:0.0:1789760691.977797:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 296021450911 time 296022416435 state 0x0 ref 1 00000100:00100000:0.0:1789760691.977893:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 296222416435 time 296022416435 state 0x1 ref 1 00000100:00100000:1.0:1789760692.111868:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 296222416435 time 296225052627 state 0x0 ref 1 00000100:00100000:1.0:1789760692.111905:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df142e43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863106176:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760692.111980:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 26214400, mtime: 0x6aad94b3, atime: 0x6aad94ae, ctime: 0x6aad94b3, blocks: 0xc807 00010000:00010000:1.0:1789760692.111990:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079e1b49a/0x3e099f5ef04ae2ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760692.112005:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=296s v=(0 0) 00010000:00010000:1.0:1789760692.112009:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760692.112026:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079e1b49a/0x3e099f5ef04ae2ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760692.112042:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079e1b49a/0x3e099f5ef04ae2ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760692.185723:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967349 is committed 00002000:00010000:2.0:1789760692.185830:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 26214400 -> 27262976 00002000:00010000:2.0:1789760692.185835:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 51207 -> 53255 00010000:00010000:2.0:1789760692.185861:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079e1b49a/0x3e099f5ef04ae2ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760692.185873:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079e1b49a/0x3e099f5ef04ae2ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760692.185882:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079e1b49a/0x3e099f5ef04ae2ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760692.185889:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f077400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760692.185893:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079e1b49a/0x3e099f5ef04ae2ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760692.185901:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079e1b49a/0x3e099f5ef04ae2ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760692.185928:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079e1b49a/0x3e099f5ef04ae2ef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760692.185936:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079e1b49a/0x3e099f5ef04ae2ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760692.186026:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df142e43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863106176:12345-192.168.203.12@tcp:4:dd.500 Request processed in 74136us (208480us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1789760692.186035:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:2.0:1789760692.186043:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 296222416435 time 296225052627 state 0x2 ref 0 00000100:00100000:0.0:1789760692.190712:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760692.190861:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863106304 00000100:00100000:2.0:1789760692.190882:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863106304 00000100:00100000:2.0:1789760692.190933:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 296222416435 time 296225052627 state 0x0 ref 1 00000100:00100000:2.0:1789760692.190946:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 296425052627 time 296225052627 state 0x1 ref 1 00000100:00100000:0.0:1789760692.312001:0:11797:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 296425052627 time 296425189412 state 0x0 ref 1 00000100:00100000:0.0:1789760692.312032:0:11797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863106304:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760692.312087:0:11797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 27262976, mtime: 0x6aad94b3, atime: 0x6aad94ae, ctime: 0x6aad94b3, blocks: 0xd007 00010000:00010000:0.0:1789760692.312096:0:11797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae2f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.312111:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=296s v=(0 0) 00010000:00010000:0.0:1789760692.312116:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760692.312123:0:11797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae2f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.312148:0:11797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae2f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789760692.378976:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:3.0:1789760692.379001:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:2.0:1789760692.380517:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789760692.380537:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df142e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883040256:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789760692.380599:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760692.380751:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883040256 00000100:00100000:2.0:1789760692.380758:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883040256 00000100:00100000:2.0:1789760692.380827:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789760692.380836:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df142e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1876699883040256:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789760692.380860:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1789760692.380891:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 8388608, mtime: 0x6aad94ab, atime: 0x6aad94a9, ctime: 0x6aad94ab, blocks: 0x4007 00010000:00010000:2.0:1789760692.380899:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c430fb76/0x3e099f5ef04ae2fd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789760692.381205:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789760692.381536:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=296s v=(0 0) 00010000:00010000:2.0:1789760692.381542:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760692.381550:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c430fb76/0x3e099f5ef04ae2fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760692.381570:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c430fb76/0x3e099f5ef04ae2fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760692.381582:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c430fb76/0x3e099f5ef04ae2fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760692.381601:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c430fb76/0x3e099f5ef04ae2fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760692.381620:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789760692.381834:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789760692.381846:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df144666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883040384:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789760692.381889:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760692.381934:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883040384 00000100:00100000:1.0:1789760692.381939:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883040384 00000100:00100000:1.0:1789760692.381976:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789760692.381984:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883040384:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789760692.382000:0:6694:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:1.0:1789760692.382029:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 8388608, mtime: 0x6aad94ab, atime: 0x6aad94a9, ctime: 0x6aad94ab, blocks: 0x4007 00010000:00010000:1.0:1789760692.382035:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae304 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760692.382045:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=296s v=(0 0) 00010000:00010000:1.0:1789760692.382048:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760692.382051:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae304 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760692.382061:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae304 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760692.382069:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae304 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760692.382076:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae304 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760692.382091:0:6694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789760692.382631:0:7646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789760692.382639:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c430fb76/0x3e099f5ef04ae2fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.383429:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b9600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760692.383434:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c430fb76/0x3e099f5ef04ae2fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.383444:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c430fb76/0x3e099f5ef04ae2fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.383464:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c430fb76/0x3e099f5ef04ae2fd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.383479:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c430fb76/0x3e099f5ef04ae2fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.383500:0:7646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789760692.383504:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae304 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.383511:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f077600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760692.383514:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae304 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.383521:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae304 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.383532:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae304 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.383538:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae304 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.383560:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760692.383562:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760692.383563:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760692.385873:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df142e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1876699883040256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5030us (5266us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1789760692.385885:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000004:00080000:0.0:1789760692.386923:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df142e42300/2, rc 0, transno 4294967323 00000100:00100000:0.0:1789760692.386934:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df142e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883040256:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789760692.387191:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1876699883040384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5206us (5300us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1789760692.387200:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1789760692.387224:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789760692.387239:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789760692.387496:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df144666680/2, rc 0, transno 4294967351 00000100:00100000:0.0:1789760692.387503:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df144666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883040384:0@lo:6:osp-syn-0-0.0 00002000:00010000:0.0:1789760692.399349:0:11797:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 27262976 -> 28311552 00002000:00010000:0.0:1789760692.399358:0:11797:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 53255 -> 55303 00010000:00010000:0.0:1789760692.399373:0:11797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae2f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.399386:0:11797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae2f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.399396:0:11797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae2f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.399403:0:11797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760692.399407:0:11797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae2f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.399416:0:11797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae2f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.399436:0:11797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae2f6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.399444:0:11797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae2f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760692.399553:0:11797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+7:2351:x1876699863106304:12345-192.168.203.12@tcp:4:dd.500 Request processed in 87526us (208855us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1789760692.399564:0:11797:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:0.0:1789760692.399572:0:11797:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 296425052627 time 296425189412 state 0x2 ref 0 00000001:00080000:0.0:1789760692.399608:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967350 is committed 00000001:00080000:2.0:1789760692.409237:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000100:00100000:0.0:1789760692.415613:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760692.416396:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863106432 00000100:00100000:2.0:1789760692.416407:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863106432 00000100:00100000:2.0:1789760692.416457:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 296425052627 time 296425189412 state 0x0 ref 1 00000100:00100000:2.0:1789760692.416470:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 296625189412 time 296425189412 state 0x1 ref 1 00010000:00010000:1.0:1789760692.431140:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760692.512644:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 296625189412 time 296625830471 state 0x0 ref 1 00000100:00100000:3.0:1789760692.512676:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d328000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863106432:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760692.512746:0:11798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 28311552, mtime: 0x6aad94b3, atime: 0x6aad94ae, ctime: 0x6aad94b3, blocks: 0xd807 00010000:00010000:3.0:1789760692.512754:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0a64689/0x3e099f5ef04ae30b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760692.512770:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=296s v=(0 0) 00010000:00010000:3.0:1789760692.512774:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760692.512781:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0a64689/0x3e099f5ef04ae30b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760692.512796:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0a64689/0x3e099f5ef04ae30b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760692.647263:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967351 is committed 00000001:00080000:3.0:1789760692.647282:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967352 is committed 00002000:00010000:0.0:1789760692.647487:0:11798:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 28311552 -> 29360128 00002000:00010000:0.0:1789760692.647493:0:11798:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 55303 -> 57351 00010000:00010000:0.0:1789760692.647507:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0a64689/0x3e099f5ef04ae30b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.647519:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0a64689/0x3e099f5ef04ae30b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.647529:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0a64689/0x3e099f5ef04ae30b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.647536:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241675c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760692.647541:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0a64689/0x3e099f5ef04ae30b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.647550:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0a64689/0x3e099f5ef04ae30b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.647568:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0a64689/0x3e099f5ef04ae30b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.647590:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0a64689/0x3e099f5ef04ae30b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760692.647700:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d328000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863106432:12345-192.168.203.12@tcp:4:dd.500 Request processed in 135025us (232083us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1789760692.647710:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:0.0:1789760692.647718:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 296625189412 time 296625830471 state 0x2 ref 0 00000100:00100000:1.0:1789760692.653478:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760692.653559:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863106560 00000100:00100000:3.0:1789760692.653581:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863106560 00000100:00100000:3.0:1789760692.653635:0:11799:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 296625189412 time 296625830471 state 0x0 ref 1 00000100:00100000:3.0:1789760692.653648:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 296825830471 time 296625830471 state 0x1 ref 1 00000100:00100000:2.0:1789760692.713316:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 296825830471 time 296826503075 state 0x0 ref 1 00000100:00100000:2.0:1789760692.713351:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d716300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863106560:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760692.713414:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 29360128, mtime: 0x6aad94b3, atime: 0x6aad94ae, ctime: 0x6aad94b3, blocks: 0xe007 00010000:00010000:2.0:1789760692.713423:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae312 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760692.713440:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=296s v=(0 0) 00010000:00010000:2.0:1789760692.713445:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760692.713451:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae312 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760692.713486:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae312 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760692.784527:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967353 is committed 00002000:00010000:0.0:1789760692.784638:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 29360128 -> 30408704 00002000:00010000:0.0:1789760692.784643:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789760691 -> 1789760692 00002000:00010000:0.0:1789760692.784645:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789760691 -> 1789760692 00002000:00010000:0.0:1789760692.784648:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 57351 -> 59399 00010000:00010000:0.0:1789760692.784662:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae312 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.784675:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae312 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.784685:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae312 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.784702:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b9200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760692.784707:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae312 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.784734:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae312 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.784755:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae312 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.784765:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae312 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760692.785101:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d716300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863106560:12345-192.168.203.12@tcp:4:dd.500 Request processed in 71760us (131625us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1789760692.785112:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:0.0:1789760692.785119:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 296825830471 time 296826503075 state 0x2 ref 0 00000100:00100000:0.0:1789760692.793018:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760692.793354:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863106688 00000100:00100000:2.0:1789760692.793365:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863106688 00000100:00100000:2.0:1789760692.793421:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 296825830471 time 296826503075 state 0x0 ref 1 00000100:00100000:2.0:1789760692.793434:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 297026503075 time 296826503075 state 0x1 ref 1 00000100:00100000:2.0:1789760692.855242:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760692.855285:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760692.855322:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760692.855354:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760692.855385:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863107072 00000100:00100000:2.0:1789760692.855395:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863107072 00000100:00100000:2.0:1789760692.855459:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:3.0:1789760692.855465:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863106944 00000100:00100000:2.0:1789760692.855469:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df142e40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863107072:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760692.855469:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863106944 00000100:00100000:3.0:1789760692.855504:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863107200 00000100:00100000:3.0:1789760692.855507:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863107200 00000100:00100000:3.0:1789760692.855526:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00100000:3.0:1789760692.855532:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df142e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+8:2349:x1876699863106944:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1789760692.855534:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df142e40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863107072:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 68us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760692.855541:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00080000:2.0:1789760692.855574:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760692.855577:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df142e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+8:2349:x1876699863106944:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 45us (344us total) trans 0 rc 0/0 00000100:00080000:2.0:1789760692.855579:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789760692.855583:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00100000:2.0:1789760692.855593:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 110 00000100:00100000:2.0:1789760692.855600:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df142e41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2349:x1876699863107200:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1789760692.855624:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df142e41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2349:x1876699863107200:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760692.855643:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 110 00000100:00100000:0.0:1789760692.855727:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863106816 00000100:00100000:0.0:1789760692.855731:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863106816 00000100:00100000:0.0:1789760692.855766:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 255 00000100:00100000:0.0:1789760692.855785:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2349:x1876699863106816:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1789760692.855849:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2349:x1876699863106816:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 75us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760692.855856:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 255 00000100:00100000:0.0:1789760692.914943:0:11797:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 297026503075 time 297028127343 state 0x0 ref 1 00000100:00100000:0.0:1789760692.914980:0:11797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d329c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863106688:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760692.915060:0:11797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 30408704, mtime: 0x6aad94b4, atime: 0x6aad94ae, ctime: 0x6aad94b4, blocks: 0xe807 00010000:00010000:0.0:1789760692.915069:0:11797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae319 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.915085:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=297s v=(0 0) 00010000:00010000:0.0:1789760692.915090:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760692.915095:0:11797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae319 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760692.915112:0:11797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae319 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760692.968120:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967354 is committed 00002000:00010000:1.0:1789760692.968341:0:11797:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 30408704 -> 31457280 00002000:00010000:1.0:1789760692.968359:0:11797:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 59399 -> 61447 00010000:00010000:1.0:1789760692.968374:0:11797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae319 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760692.968387:0:11797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae319 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760692.968396:0:11797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae319 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760692.968403:0:11797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760692.968408:0:11797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae319 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760692.968418:0:11797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae319 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760692.968437:0:11797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae319 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760692.968446:0:11797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae319 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760692.968547:0:11797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d329c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863106688:12345-192.168.203.12@tcp:4:dd.500 Request processed in 53578us (175533us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1789760692.968558:0:11797:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:1.0:1789760692.968568:0:11797:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 297026503075 time 297028127343 state 0x2 ref 0 00000100:00100000:0.0:1789760692.976954:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760692.977108:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863107328 00000100:00100000:2.0:1789760692.977120:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863107328 00000100:00100000:2.0:1789760692.977180:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 297026503075 time 297028127343 state 0x0 ref 1 00000100:00100000:2.0:1789760692.977193:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 297228127343 time 297028127343 state 0x1 ref 1 00000100:00100000:0.0:1789760693.115372:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 297228127343 time 297228556048 state 0x0 ref 1 00000100:00100000:0.0:1789760693.115424:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863107328:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760693.115489:0:11798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 31457280, mtime: 0x6aad94b4, atime: 0x6aad94ae, ctime: 0x6aad94b4, blocks: 0xf007 00010000:00010000:0.0:1789760693.115498:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae320 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760693.115514:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=297s v=(0 0) 00010000:00010000:0.0:1789760693.115519:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760693.115526:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae320 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760693.115540:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae320 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789760693.115776:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789760693.198669:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967355 is committed 00002000:00010000:0.0:1789760693.198873:0:11798:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 31457280 -> 32505856 00002000:00010000:0.0:1789760693.198878:0:11798:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 61447 -> 63495 00010000:00010000:0.0:1789760693.198893:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae320 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760693.198907:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae320 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760693.198916:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae320 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760693.198924:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760693.198929:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae320 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760693.198939:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae320 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760693.198959:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae320 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760693.198968:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae320 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760693.199260:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863107328:12345-192.168.203.12@tcp:4:dd.500 Request processed in 83865us (222311us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1789760693.199296:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:0.0:1789760693.199304:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 297228127343 time 297228556048 state 0x2 ref 0 00000100:00100000:3.0:1789760693.205758:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760693.205939:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863107456 00000100:00100000:2.0:1789760693.205950:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863107456 00000100:00100000:2.0:1789760693.206003:0:11799:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 297228127343 time 297228556048 state 0x0 ref 1 00000100:00100000:2.0:1789760693.206016:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 297428556048 time 297228556048 state 0x1 ref 1 00000100:00100000:0.0:1789760693.315562:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 297428556048 time 297428745646 state 0x0 ref 1 00000100:00100000:0.0:1789760693.315598:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14347e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863107456:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760693.315664:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 32505856, mtime: 0x6aad94b4, atime: 0x6aad94ae, ctime: 0x6aad94b4, blocks: 0xf807 00010000:00010000:0.0:1789760693.315673:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae327 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760693.315702:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=297s v=(0 0) 00010000:00010000:0.0:1789760693.315707:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760693.315714:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae327 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760693.315728:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae327 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760693.421334:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967356 is committed 00002000:00010000:0.0:1789760693.421448:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 32505856 -> 33554432 00002000:00010000:0.0:1789760693.421455:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 63495 -> 65543 00010000:00010000:0.0:1789760693.421475:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae327 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760693.421490:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae327 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760693.421525:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae327 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760693.421533:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760693.421539:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae327 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760693.421548:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae327 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760693.421575:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae327 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760693.421584:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae327 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760693.421763:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14347e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863107456:12345-192.168.203.12@tcp:4:dd.500 Request processed in 106175us (216007us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1789760693.421775:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:0.0:1789760693.421786:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 297428556048 time 297428745646 state 0x2 ref 0 00000100:00100000:0.0:1789760693.439328:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760693.440035:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863107584 00000100:00100000:2.0:1789760693.440052:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863107584 00000100:00100000:0.0:1789760693.440251:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 297428556048 time 297428745646 state 0x0 ref 1 00000100:00100000:0.0:1789760693.440267:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 297628745646 time 297428745646 state 0x1 ref 1 00010000:00010000:0.0:1789760693.455351:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760693.519757:0:11797:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 297628745646 time 297632935976 state 0x0 ref 1 00000100:00100000:1.0:1789760693.520183:0:11797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d328700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863107584:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760693.520265:0:11797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 33554432, mtime: 0x6aad94b4, atime: 0x6aad94ae, ctime: 0x6aad94b4, blocks: 0x10007 00010000:00010000:1.0:1789760693.520275:0:11797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae32e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760693.520294:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=297s v=(0 0) 00010000:00010000:1.0:1789760693.520299:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760693.520306:0:11797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae32e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760693.520367:0:11797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae32e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760693.643843:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967357 is committed 00002000:00010000:1.0:1789760693.644740:0:11797:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 33554432 -> 34603008 00002000:00010000:1.0:1789760693.644745:0:11797:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 65543 -> 67591 00010000:00010000:1.0:1789760693.644759:0:11797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae32e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760693.644781:0:11797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae32e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760693.644790:0:11797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae32e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760693.644861:0:11797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760693.644867:0:11797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae32e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760693.644881:0:11797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae32e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760693.644914:0:11797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae32e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760693.644923:0:11797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae32e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760693.645178:0:11797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d328700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863107584:12345-192.168.203.12@tcp:4:dd.500 Request processed in 125392us (205861us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1789760693.645190:0:11797:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:1.0:1789760693.645200:0:11797:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 297628745646 time 297632935976 state 0x2 ref 0 00000100:00100000:0.0:1789760693.663072:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760693.663181:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863107712 00000100:00100000:2.0:1789760693.663192:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863107712 00000100:00100000:2.0:1789760693.663255:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 297628745646 time 297632935976 state 0x0 ref 1 00000100:00100000:2.0:1789760693.663268:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 297832935976 time 297632935976 state 0x1 ref 1 00000100:00100000:0.0:1789760693.720772:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 297832935976 time 297833951022 state 0x0 ref 1 00000100:00100000:0.0:1789760693.720841:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863107712:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760693.720901:0:11798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 34603008, mtime: 0x6aad94b4, atime: 0x6aad94ae, ctime: 0x6aad94b4, blocks: 0x10807 00010000:00010000:0.0:1789760693.720910:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae335 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760693.720925:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=297s v=(0 0) 00010000:00010000:0.0:1789760693.720929:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760693.720935:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae335 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760693.720948:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae335 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760693.801891:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967358 is committed 00002000:00010000:0.0:1789760693.802048:0:11798:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 34603008 -> 35651584 00002000:00010000:0.0:1789760693.802053:0:11798:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789760692 -> 1789760693 00002000:00010000:0.0:1789760693.802055:0:11798:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789760692 -> 1789760693 00002000:00010000:0.0:1789760693.802058:0:11798:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 67591 -> 69639 00010000:00010000:0.0:1789760693.802074:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae335 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760693.802086:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae335 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760693.802111:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae335 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760693.802120:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760693.802124:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae335 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760693.802133:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae335 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760693.802153:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae335 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760693.802228:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae335 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760693.802368:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863107712:12345-192.168.203.12@tcp:4:dd.500 Request processed in 81573us (139302us total) trans 4294967358 rc 0/0 00000100:00100000:0.0:1789760693.802379:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:0.0:1789760693.802386:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 297832935976 time 297833951022 state 0x2 ref 0 00000100:00100000:0.0:1789760693.821654:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760693.822020:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863107840 00000100:00100000:2.0:1789760693.822030:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863107840 00000100:00100000:2.0:1789760693.822103:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 297832935976 time 297833951022 state 0x0 ref 1 00000100:00100000:2.0:1789760693.822120:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 298033951022 time 297833951022 state 0x1 ref 1 00000100:00100000:2.0:1789760693.839435:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14347dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883040512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760693.839514:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760693.839727:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883040512 00000100:00100000:0.0:1789760693.839736:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883040512 00000100:00100000:0.0:1789760693.839823:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789760693.839833:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df142e43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883040512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789760693.839863:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 129433600 pending 0 free 3829399552 avail 3822059520 00000100:00100000:0.0:1789760693.842544:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df142e43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883040512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2704us (3022us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760693.842559:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789760693.844549:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967351 gen 2 00000004:00080000:2.0:1789760693.844558:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df144666680, transno 4294967351 00000100:00100000:2.0:1789760693.844592:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14347dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883040512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789760693.923157:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 298033951022 time 298036343131 state 0x0 ref 1 00000100:00100000:0.0:1789760693.923199:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863107840:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760693.923459:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 35651584, mtime: 0x6aad94b5, atime: 0x6aad94ae, ctime: 0x6aad94b5, blocks: 0x11007 00010000:00010000:0.0:1789760693.923469:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae33c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760693.923485:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=298s v=(0 0) 00010000:00010000:0.0:1789760693.923489:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760693.923495:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae33c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760693.923511:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae33c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760694.026577:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967359 is committed 00002000:00010000:1.0:1789760694.026693:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 35651584 -> 36700160 00002000:00010000:1.0:1789760694.026698:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 69639 -> 71687 00010000:00010000:1.0:1789760694.026721:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae33c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760694.026735:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae33c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760694.026757:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae33c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760694.026765:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760694.026770:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae33c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760694.026779:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae33c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760694.026797:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae33c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760694.026837:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae33c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760694.027280:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863107840:12345-192.168.203.12@tcp:4:dd.500 Request processed in 104093us (205631us total) trans 4294967359 rc 0/0 00000100:00100000:0.0:1789760694.027291:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:0.0:1789760694.027299:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 298033951022 time 298036343131 state 0x2 ref 0 00000100:00100000:2.0:1789760694.043492:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760694.043590:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863107968 00000100:00100000:3.0:1789760694.043599:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863107968 00000100:00100000:3.0:1789760694.043877:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 298033951022 time 298036343131 state 0x0 ref 1 00000100:00100000:3.0:1789760694.043892:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 298236343131 time 298036343131 state 0x1 ref 1 00000100:00100000:1.0:1789760694.123436:0:11797:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 298236343131 time 298236620538 state 0x0 ref 1 00000100:00100000:1.0:1789760694.123471:0:11797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df142e43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863107968:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760694.123526:0:11797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 36700160, mtime: 0x6aad94b5, atime: 0x6aad94ae, ctime: 0x6aad94b5, blocks: 0x11807 00010000:00010000:1.0:1789760694.123535:0:11797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae343 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760694.123551:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=298s v=(0 0) 00010000:00010000:1.0:1789760694.123556:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760694.123576:0:11797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae343 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760694.123589:0:11797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae343 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760694.186656:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967360 is committed 00002000:00010000:1.0:1789760694.187071:0:11797:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 36700160 -> 37748736 00002000:00010000:1.0:1789760694.187076:0:11797:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 71687 -> 73735 00010000:00010000:1.0:1789760694.187090:0:11797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae343 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760694.187103:0:11797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae343 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760694.187177:0:11797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae343 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760694.187185:0:11797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760694.187190:0:11797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae343 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760694.187199:0:11797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae343 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760694.187220:0:11797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae343 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760694.187246:0:11797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae343 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760694.187351:0:11797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df142e43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863107968:12345-192.168.203.12@tcp:4:dd.500 Request processed in 63893us (144279us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1789760694.187362:0:11797:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:1.0:1789760694.187371:0:11797:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 298236343131 time 298236620538 state 0x2 ref 0 00000100:00100000:2.0:1789760694.201434:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760694.201540:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863108096 00000100:00100000:0.0:1789760694.201560:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863108096 00000100:00100000:0.0:1789760694.201618:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 298236343131 time 298236620538 state 0x0 ref 1 00000100:00100000:0.0:1789760694.201631:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 298436620538 time 298236620538 state 0x1 ref 1 00000100:00100000:0.0:1789760694.324139:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 298436620538 time 298437323275 state 0x0 ref 1 00000100:00100000:0.0:1789760694.324184:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df142e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863108096:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760694.324247:0:11798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 37748736, mtime: 0x6aad94b5, atime: 0x6aad94ae, ctime: 0x6aad94b5, blocks: 0x12007 00010000:00010000:0.0:1789760694.324256:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae34a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760694.324271:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=298s v=(0 0) 00010000:00010000:0.0:1789760694.324276:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760694.324282:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae34a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760694.324296:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae34a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760694.443913:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967361 is committed 00002000:00010000:2.0:1789760694.443980:0:11798:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 37748736 -> 38797312 00002000:00010000:2.0:1789760694.443984:0:11798:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 73735 -> 75783 00010000:00010000:2.0:1789760694.443999:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae34a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760694.444021:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae34a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760694.444030:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae34a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760694.444037:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760694.444042:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae34a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760694.444050:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae34a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760694.444072:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae34a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760694.444101:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae34a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760694.444194:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df142e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863108096:12345-192.168.203.12@tcp:4:dd.500 Request processed in 120035us (242766us total) trans 4294967361 rc 0/0 00000100:00100000:2.0:1789760694.444205:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:2.0:1789760694.444212:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 298436620538 time 298437323275 state 0x2 ref 0 00000100:00100000:2.0:1789760694.457620:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760694.458218:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863108224 00000100:00100000:0.0:1789760694.458230:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863108224 00000100:00100000:0.0:1789760694.458283:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 298436620538 time 298437323275 state 0x0 ref 1 00000100:00100000:0.0:1789760694.458296:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 298637323275 time 298437323275 state 0x1 ref 1 00010000:00010000:1.0:1789760694.480221:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760694.524860:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 298637323275 time 298638039277 state 0x0 ref 1 00000100:00100000:0.0:1789760694.524904:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df142e41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863108224:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760694.524979:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 38797312, mtime: 0x6aad94b5, atime: 0x6aad94ae, ctime: 0x6aad94b5, blocks: 0x12807 00010000:00010000:0.0:1789760694.524989:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae351 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760694.525005:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=298s v=(0 0) 00010000:00010000:0.0:1789760694.525009:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760694.525015:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae351 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760694.525030:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae351 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760694.606303:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967362 is committed 00002000:00010000:2.0:1789760694.607102:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 38797312 -> 39845888 00002000:00010000:2.0:1789760694.607109:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 75783 -> 77831 00010000:00010000:2.0:1789760694.607124:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae351 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760694.607137:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae351 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760694.607145:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae351 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760694.607152:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760694.607157:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae351 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760694.607166:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae351 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760694.607210:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae351 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760694.607218:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae351 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760694.607306:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df142e41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863108224:12345-192.168.203.12@tcp:4:dd.500 Request processed in 82425us (149690us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1789760694.607315:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:2.0:1789760694.607324:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 298637323275 time 298638039277 state 0x2 ref 0 00000100:00100000:1.0:1789760694.613553:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760694.613652:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863108352 00000100:00100000:0.0:1789760694.613662:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863108352 00000100:00100000:0.0:1789760694.613722:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 298637323275 time 298638039277 state 0x0 ref 1 00000100:00100000:0.0:1789760694.613734:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 298838039277 time 298638039277 state 0x1 ref 1 00000100:00100000:1.0:1789760694.725004:0:11797:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 298838039277 time 298838191290 state 0x0 ref 1 00000100:00100000:1.0:1789760694.725036:0:11797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144605880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863108352:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760694.725094:0:11797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 39845888, mtime: 0x6aad94b5, atime: 0x6aad94ae, ctime: 0x6aad94b5, blocks: 0x13007 00010000:00010000:1.0:1789760694.725103:0:11797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae358 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760694.725128:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=298s v=(0 0) 00010000:00010000:1.0:1789760694.725132:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760694.725146:0:11797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae358 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760694.725161:0:11797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae358 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760694.773027:0:11797:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 39845888 -> 40894464 00002000:00010000:3.0:1789760694.773035:0:11797:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789760693 -> 1789760694 00002000:00010000:3.0:1789760694.773037:0:11797:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789760693 -> 1789760694 00002000:00010000:3.0:1789760694.773040:0:11797:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 77831 -> 79879 00010000:00010000:3.0:1789760694.773053:0:11797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae358 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760694.773079:0:11797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae358 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760694.773089:0:11797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae358 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760694.773096:0:11797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760694.773101:0:11797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae358 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760694.773109:0:11797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae358 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760694.773128:0:11797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae358 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760694.773135:0:11797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae358 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760694.773239:0:11797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144605880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+7:2349:x1876699863108352:12345-192.168.203.12@tcp:4:dd.500 Request processed in 48214us (159691us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1789760694.773249:0:11797:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:3.0:1789760694.773256:0:11797:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 298838039277 time 298838191290 state 0x2 ref 0 00000001:00080000:3.0:1789760694.773293:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967363 is committed 00000100:00100000:3.0:1789760694.779021:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760694.779128:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863108480 00000100:00100000:0.0:1789760694.779138:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863108480 00000100:00100000:0.0:1789760694.779199:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 298838039277 time 298838191290 state 0x0 ref 1 00000100:00100000:0.0:1789760694.779211:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 299038191290 time 298838191290 state 0x1 ref 1 00000100:00100000:2.0:1789760694.925984:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 299038191290 time 299039169357 state 0x0 ref 1 00000100:00100000:2.0:1789760694.926018:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14347d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863108480:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760694.926077:0:11798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 40894464, mtime: 0x6aad94b6, atime: 0x6aad94ae, ctime: 0x6aad94b6, blocks: 0x13807 00010000:00010000:2.0:1789760694.926085:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a4e18fa/0x3e099f5ef04ae35f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760694.926102:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=299s v=(0 0) 00010000:00010000:2.0:1789760694.926107:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760694.926113:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a4e18fa/0x3e099f5ef04ae35f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760694.926129:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a4e18fa/0x3e099f5ef04ae35f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760694.984224:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967364 is committed 00002000:00010000:3.0:1789760694.984722:0:11798:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 40894464 -> 41943040 00002000:00010000:3.0:1789760694.984729:0:11798:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 79879 -> 81927 00010000:00010000:3.0:1789760694.984744:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a4e18fa/0x3e099f5ef04ae35f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760694.984757:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a4e18fa/0x3e099f5ef04ae35f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760694.984767:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a4e18fa/0x3e099f5ef04ae35f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760694.984774:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b9000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760694.984779:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a4e18fa/0x3e099f5ef04ae35f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760694.984789:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a4e18fa/0x3e099f5ef04ae35f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760694.984871:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a4e18fa/0x3e099f5ef04ae35f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760694.984881:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a4e18fa/0x3e099f5ef04ae35f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760694.985119:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14347d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863108480:12345-192.168.203.12@tcp:4:dd.500 Request processed in 59113us (206105us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789760694.985147:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:3.0:1789760694.985154:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 299038191290 time 299039169357 state 0x2 ref 0 00000100:00100000:2.0:1789760694.993496:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760694.993644:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863108608 00000100:00100000:0.0:1789760694.993653:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863108608 00000100:00100000:0.0:1789760694.993715:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 299038191290 time 299039169357 state 0x0 ref 1 00000100:00100000:0.0:1789760694.993727:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 299239169357 time 299039169357 state 0x1 ref 1 00000100:00100000:2.0:1789760695.126140:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 299239169357 time 299239325282 state 0x0 ref 1 00000100:00100000:2.0:1789760695.126197:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d6f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863108608:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760695.126254:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 41943040, mtime: 0x6aad94b6, atime: 0x6aad94ae, ctime: 0x6aad94b6, blocks: 0x14007 00010000:00010000:2.0:1789760695.126262:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb76d6dc/0x3e099f5ef04ae366 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760695.126278:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=299s v=(0 0) 00010000:00010000:2.0:1789760695.126283:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760695.126289:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb76d6dc/0x3e099f5ef04ae366 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760695.126304:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb76d6dc/0x3e099f5ef04ae366 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789760695.126525:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789760695.179267:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967365 is committed 00002000:00010000:3.0:1789760695.179267:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 41943040 -> 42991616 00002000:00010000:3.0:1789760695.179275:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 81927 -> 83975 00010000:00010000:3.0:1789760695.179289:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb76d6dc/0x3e099f5ef04ae366 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760695.179302:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb76d6dc/0x3e099f5ef04ae366 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760695.179312:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb76d6dc/0x3e099f5ef04ae366 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760695.179320:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b9c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760695.179325:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb76d6dc/0x3e099f5ef04ae366 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760695.179394:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb76d6dc/0x3e099f5ef04ae366 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760695.179460:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb76d6dc/0x3e099f5ef04ae366 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760695.179469:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb76d6dc/0x3e099f5ef04ae366 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760695.179590:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d6f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863108608:12345-192.168.203.12@tcp:4:dd.500 Request processed in 53427us (186100us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789760695.179601:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:3.0:1789760695.179608:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 299239169357 time 299239325282 state 0x2 ref 0 00000100:00100000:0.0:1789760695.186753:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760695.186838:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863108736 00000100:00100000:2.0:1789760695.186848:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863108736 00000100:00100000:2.0:1789760695.186901:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 299239169357 time 299239325282 state 0x0 ref 1 00000100:00100000:2.0:1789760695.186914:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 299439325282 time 299239325282 state 0x1 ref 1 00000100:00100000:3.0:1789760695.326300:0:11797:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 299439325282 time 299439484459 state 0x0 ref 1 00000100:00100000:3.0:1789760695.326335:0:11797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863108736:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760695.326395:0:11797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 42991616, mtime: 0x6aad94b6, atime: 0x6aad94ae, ctime: 0x6aad94b6, blocks: 0x14807 00010000:00010000:3.0:1789760695.326415:0:11797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2af73a2/0x3e099f5ef04ae36d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760695.326432:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=299s v=(0 0) 00010000:00010000:3.0:1789760695.326437:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760695.326443:0:11797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2af73a2/0x3e099f5ef04ae36d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760695.326457:0:11797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2af73a2/0x3e099f5ef04ae36d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760695.376039:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e2780560-8e82-4256-94b0-2e524f3bed06:3309:1876699883040640:0@lo:400:kworker.0 00000100:00100000:0.0:1789760695.376104:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760695.376153:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cb21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1876699883041152:0@lo:400:kworker.0 00000100:00100000:0.0:1789760695.376177:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760695.376203:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789760695.376209:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cb20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883041024:0@lo:400:kworker.0 00000100:00100000:0.0:1789760695.376233:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760695.376262:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876699883040768:0@lo:400:kworker.0 00000100:00100000:0.0:1789760695.376283:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760695.376299:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cb20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883041280:0@lo:400:kworker.0 00000100:00100000:0.0:1789760695.376320:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760695.376337:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789760695.376342:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cb22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1876699883040896:0@lo:400:kworker.0 00000100:00100000:0.0:1789760695.376361:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760695.376392:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883040640 00000100:00100000:2.0:1789760695.376958:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883041152 00000100:00100000:2.0:1789760695.376964:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883041152 00000100:00100000:2.0:1789760695.377021:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883040768 00000100:00100000:2.0:1789760695.377040:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883040768 00000100:00100000:2.0:1789760695.377057:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883040896 00000100:00100000:2.0:1789760695.377059:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883040896 00000100:00100000:2.0:1789760695.377079:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789760695.377088:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876699883041152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760695.377152:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876699883041152:12345-0@lo:400:kworker.0 Request processed in 65us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760695.377159:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789760695.377176:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789760695.377181:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876699883040768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760695.377213:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876699883040768:12345-0@lo:400:kworker.0 Request processed in 31us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760695.377219:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789760695.377232:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789760695.377237:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876699883040896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760695.377264:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876699883040896:12345-0@lo:400:kworker.0 Request processed in 27us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760695.377269:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:2.0:1789760695.377285:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760695.377586:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883040640 00000100:00100000:0.0:1789760695.377619:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789760695.377626:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3309:x1876699883040640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760695.377658:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3309:x1876699883040640:12345-0@lo:400:kworker.0 Request processed in 33us (1554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760695.377664:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789760695.377886:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883041024 00000100:00100000:0.0:1789760695.377891:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883041024 00000100:00100000:0.0:1789760695.377923:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883041280 00000100:00100000:0.0:1789760695.377936:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883041280 00000100:00100000:0.0:1789760695.377966:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789760695.377974:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883041024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760695.378012:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883041024:12345-0@lo:400:kworker.0 Request processed in 39us (1777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760695.378019:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789760695.378032:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789760695.378038:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1876699883041280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760695.378064:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1876699883041280:12345-0@lo:400:kworker.0 Request processed in 26us (1743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760695.378069:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789760695.378115:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cb20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883041024:0@lo:400:kworker.0 00000100:00100000:0.0:1789760695.378127:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e2780560-8e82-4256-94b0-2e524f3bed06:3309:1876699883040640:0@lo:400:kworker.0 00000100:00100000:0.0:1789760695.378138:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cb21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1876699883041152:0@lo:400:kworker.0 00000100:00100000:0.0:1789760695.378173:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cb22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1876699883040896:0@lo:400:kworker.0 00000100:00100000:0.0:1789760695.378184:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876699883040768:0@lo:400:kworker.0 00000100:00100000:0.0:1789760695.378195:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1789760695.378200:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df144606680, transno 4294967322 00000100:00100000:0.0:1789760695.378217:0:3310:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8df142e42300 x1876699883040256/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789760708 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760695.378228:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cb20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883041280:0@lo:400:kworker.0 00000100:00080000:0.0:1789760695.378251:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789760695.378254:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789760695.448170:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967366 is committed 00002000:00010000:0.0:1789760695.458188:0:11797:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 42991616 -> 44040192 00002000:00010000:0.0:1789760695.458214:0:11797:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 83975 -> 86023 00010000:00010000:0.0:1789760695.458230:0:11797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2af73a2/0x3e099f5ef04ae36d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760695.458242:0:11797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2af73a2/0x3e099f5ef04ae36d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760695.458252:0:11797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2af73a2/0x3e099f5ef04ae36d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760695.458260:0:11797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241675e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760695.458265:0:11797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2af73a2/0x3e099f5ef04ae36d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760695.458274:0:11797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2af73a2/0x3e099f5ef04ae36d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760695.458295:0:11797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2af73a2/0x3e099f5ef04ae36d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760695.458303:0:11797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2af73a2/0x3e099f5ef04ae36d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760695.458409:0:11797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863108736:12345-192.168.203.12@tcp:4:dd.500 Request processed in 132086us (271662us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1789760695.458420:0:11797:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:0.0:1789760695.458436:0:11797:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 299439325282 time 299439484459 state 0x2 ref 0 00000100:00100000:0.0:1789760695.472951:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760695.473210:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863108864 00000100:00100000:2.0:1789760695.473224:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863108864 00000100:00100000:2.0:1789760695.473283:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 299439325282 time 299439484459 state 0x0 ref 1 00000100:00100000:2.0:1789760695.473295:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 299639484459 time 299439484459 state 0x1 ref 1 00010000:00010000:1.0:1789760695.504583:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760695.526686:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 299639484459 time 299639857869 state 0x0 ref 1 00000100:00100000:3.0:1789760695.526737:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863108864:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760695.526874:0:11798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 44040192, mtime: 0x6aad94b6, atime: 0x6aad94ae, ctime: 0x6aad94b6, blocks: 0x15007 00010000:00010000:3.0:1789760695.526904:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae374 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760695.526923:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=299s v=(0 0) 00010000:00010000:3.0:1789760695.526929:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760695.526937:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae374 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760695.526955:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae374 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760695.657839:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967367 is committed 00002000:00010000:3.0:1789760695.658042:0:11798:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 44040192 -> 45088768 00002000:00010000:3.0:1789760695.658058:0:11798:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 86023 -> 88071 00010000:00010000:3.0:1789760695.658072:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae374 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760695.658085:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae374 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760695.658094:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae374 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760695.658100:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760695.658105:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae374 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760695.658113:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae374 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760695.658145:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae374 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760695.658153:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae374 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760695.658299:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863108864:12345-192.168.203.12@tcp:4:dd.500 Request processed in 131584us (185357us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1789760695.658310:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:3.0:1789760695.658317:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 299639484459 time 299639857869 state 0x2 ref 0 00000100:00100000:2.0:1789760695.668226:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760695.668591:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863108992 00000100:00100000:3.0:1789760695.668601:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863108992 00000100:00100000:3.0:1789760695.668652:0:11799:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 299639484459 time 299639857869 state 0x0 ref 1 00000100:00100000:3.0:1789760695.668685:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 299839857869 time 299639857869 state 0x1 ref 1 00000100:00100000:3.0:1789760695.726797:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 299839857869 time 299839982082 state 0x0 ref 1 00000100:00100000:3.0:1789760695.726864:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d6f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863108992:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760695.727236:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 45088768, mtime: 0x6aad94b6, atime: 0x6aad94ae, ctime: 0x6aad94b6, blocks: 0x15807 00010000:00010000:2.0:1789760695.727246:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae37b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760695.727514:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=299s v=(0 0) 00010000:00010000:2.0:1789760695.727520:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760695.727526:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae37b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760695.727542:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae37b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760695.807429:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967368 is committed 00002000:00010000:2.0:1789760695.807693:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 45088768 -> 46137344 00002000:00010000:2.0:1789760695.807698:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789760694 -> 1789760695 00002000:00010000:2.0:1789760695.807701:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789760694 -> 1789760695 00002000:00010000:2.0:1789760695.807704:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 88071 -> 90121 00010000:00010000:2.0:1789760695.807719:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae37b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760695.807740:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae37b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760695.807750:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae37b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760695.807758:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b8400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760695.807763:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae37b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760695.807773:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae37b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760695.807833:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae37b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760695.807841:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae37b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760695.808082:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d6f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863108992:12345-192.168.203.12@tcp:4:dd.500 Request processed in 81228us (139858us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1789760695.808093:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:2.0:1789760695.808101:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 299839857869 time 299839982082 state 0x2 ref 0 00000100:00100000:2.0:1789760695.825634:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760695.825891:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863109120 00000100:00100000:1.0:1789760695.825911:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863109120 00000100:00100000:1.0:1789760695.825971:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 299839857869 time 299839982082 state 0x0 ref 1 00000100:00100000:1.0:1789760695.825985:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 300039982082 time 299839982082 state 0x1 ref 1 00000100:00100000:0.0:1789760695.890202:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14347d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883041408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760695.890280:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760695.891349:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883041408 00000100:00100000:3.0:1789760695.891363:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883041408 00000100:00100000:3.0:1789760695.891444:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789760695.891457:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876699883041408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789760695.891506:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1789760695.891609:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876699883041408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (1328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760695.891634:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789760695.891719:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14347d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883041408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760695.928110:0:11797:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 300039982082 time 300041295989 state 0x0 ref 1 00000100:00100000:0.0:1789760695.928142:0:11797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d6f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863109120:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760695.928198:0:11797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 46137344, mtime: 0x6aad94b7, atime: 0x6aad94ae, ctime: 0x6aad94b7, blocks: 0x16009 00010000:00010000:0.0:1789760695.928208:0:11797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae382 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760695.928225:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=300s v=(0 0) 00010000:00010000:0.0:1789760695.928229:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760695.928236:0:11797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae382 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760695.928252:0:11797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae382 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760696.058656:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967369 is committed 00002000:00010000:2.0:1789760696.058914:0:11797:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 46137344 -> 47185920 00002000:00010000:2.0:1789760696.058920:0:11797:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 90121 -> 92169 00010000:00010000:2.0:1789760696.058947:0:11797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae382 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760696.058959:0:11797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae382 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760696.058967:0:11797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae382 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760696.058974:0:11797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760696.058979:0:11797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae382 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760696.059003:0:11797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae382 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760696.059025:0:11797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae382 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760696.059032:0:11797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae382 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760696.059131:0:11797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d6f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863109120:12345-192.168.203.12@tcp:4:dd.500 Request processed in 131001us (233503us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1789760696.059141:0:11797:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:2.0:1789760696.059148:0:11797:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 300039982082 time 300041295989 state 0x2 ref 0 00000100:00100000:2.0:1789760696.084489:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760696.088064:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863109248 00000100:00100000:0.0:1789760696.088078:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863109248 00000100:00100000:0.0:1789760696.088137:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 300039982082 time 300041295989 state 0x0 ref 1 00000100:00100000:0.0:1789760696.088149:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 300241295989 time 300041295989 state 0x1 ref 1 00000100:00100000:3.0:1789760696.128295:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 300241295989 time 300241481105 state 0x0 ref 1 00000100:00100000:3.0:1789760696.128326:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d6f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863109248:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760696.128380:0:11798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 47185920, mtime: 0x6aad94b7, atime: 0x6aad94ae, ctime: 0x6aad94b7, blocks: 0x16809 00010000:00010000:3.0:1789760696.128389:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae389 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760696.128404:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=300s v=(0 0) 00010000:00010000:3.0:1789760696.128408:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760696.128414:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae389 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760696.128428:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae389 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760696.211184:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967370 is committed 00002000:00010000:2.0:1789760696.211404:0:11798:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 47185920 -> 48234496 00002000:00010000:2.0:1789760696.211409:0:11798:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 92169 -> 94217 00010000:00010000:2.0:1789760696.211421:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae389 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760696.211432:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae389 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760696.211440:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae389 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760696.211465:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760696.211469:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae389 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760696.211479:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae389 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760696.211498:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae389 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760696.211506:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae389 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760696.211602:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d6f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863109248:12345-192.168.203.12@tcp:4:dd.500 Request processed in 83286us (127119us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1789760696.211612:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:2.0:1789760696.211620:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 300241295989 time 300241481105 state 0x2 ref 0 00000100:00100000:2.0:1789760696.222238:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760696.222637:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863109376 00000100:00100000:3.0:1789760696.222647:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863109376 00000100:00100000:3.0:1789760696.223118:0:11799:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 300241295989 time 300241481105 state 0x0 ref 1 00000100:00100000:3.0:1789760696.223134:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 300441481105 time 300241481105 state 0x1 ref 1 00000100:00100000:2.0:1789760696.328565:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 300441481105 time 300441741325 state 0x0 ref 1 00000100:00100000:2.0:1789760696.328600:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d6f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863109376:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760696.328672:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 48234496, mtime: 0x6aad94b7, atime: 0x6aad94ae, ctime: 0x6aad94b7, blocks: 0x17009 00010000:00010000:2.0:1789760696.328681:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae390 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760696.328722:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=300s v=(0 0) 00010000:00010000:2.0:1789760696.328727:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760696.328733:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae390 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760696.328746:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae390 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760696.442843:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967371 is committed 00002000:00010000:1.0:1789760696.445592:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 48234496 -> 49283072 00002000:00010000:1.0:1789760696.445602:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 94217 -> 96265 00010000:00010000:1.0:1789760696.445616:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae390 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760696.445629:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae390 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760696.445638:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae390 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760696.445646:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b9200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760696.445651:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae390 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760696.445693:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae390 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760696.445713:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae390 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760696.445721:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011c8fdbd/0x3e099f5ef04ae390 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760696.445860:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d6f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863109376:12345-192.168.203.12@tcp:4:dd.500 Request processed in 117271us (223635us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1789760696.445870:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:1.0:1789760696.445877:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 300441481105 time 300441741325 state 0x2 ref 0 00000100:00100000:2.0:1789760696.453854:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760696.453954:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863109504 00000100:00100000:1.0:1789760696.453965:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863109504 00000100:00100000:1.0:1789760696.454021:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 300441481105 time 300441741325 state 0x0 ref 1 00000100:00100000:1.0:1789760696.454035:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 300641741325 time 300441741325 state 0x1 ref 1 00010000:00010000:0.0:1789760696.526981:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760696.528687:0:11797:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 300641741325 time 300641875991 state 0x0 ref 1 00000100:00100000:2.0:1789760696.528716:0:11797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d6f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863109504:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760696.528783:0:11797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 49283072, mtime: 0x6aad94b7, atime: 0x6aad94ae, ctime: 0x6aad94b7, blocks: 0x17809 00010000:00010000:2.0:1789760696.528792:0:11797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098bab9ef/0x3e099f5ef04ae397 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760696.528840:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=300s v=(0 0) 00010000:00010000:2.0:1789760696.528844:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760696.528851:0:11797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098bab9ef/0x3e099f5ef04ae397 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760696.528865:0:11797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098bab9ef/0x3e099f5ef04ae397 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760696.667297:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967372 is committed 00002000:00010000:1.0:1789760696.669083:0:11797:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 49283072 -> 50331648 00002000:00010000:1.0:1789760696.669092:0:11797:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 96265 -> 98313 00010000:00010000:1.0:1789760696.669106:0:11797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098bab9ef/0x3e099f5ef04ae397 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760696.669119:0:11797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098bab9ef/0x3e099f5ef04ae397 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760696.669141:0:11797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098bab9ef/0x3e099f5ef04ae397 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760696.669147:0:11797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b9a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760696.669152:0:11797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098bab9ef/0x3e099f5ef04ae397 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760696.669160:0:11797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098bab9ef/0x3e099f5ef04ae397 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760696.669180:0:11797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098bab9ef/0x3e099f5ef04ae397 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760696.669188:0:11797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098bab9ef/0x3e099f5ef04ae397 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760696.669300:0:11797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d6f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863109504:12345-192.168.203.12@tcp:4:dd.500 Request processed in 140593us (215453us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1789760696.669310:0:11797:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:1.0:1789760696.669318:0:11797:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 300641741325 time 300641875991 state 0x2 ref 0 00000100:00100000:2.0:1789760696.685082:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760696.685186:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863109632 00000100:00100000:0.0:1789760696.685196:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863109632 00000100:00100000:0.0:1789760696.685263:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 300641741325 time 300641875991 state 0x0 ref 1 00000100:00100000:0.0:1789760696.685277:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 300841875991 time 300641875991 state 0x1 ref 1 00000100:00100000:2.0:1789760696.728918:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 300841875991 time 300842103683 state 0x0 ref 1 00000100:00100000:2.0:1789760696.728950:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d6f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863109632:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760696.729005:0:11798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 50331648, mtime: 0x6aad94b7, atime: 0x6aad94ae, ctime: 0x6aad94b7, blocks: 0x18009 00010000:00010000:2.0:1789760696.729014:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000461f5f7f/0x3e099f5ef04ae39e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760696.729029:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=300s v=(0 0) 00010000:00010000:2.0:1789760696.729033:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760696.729038:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000461f5f7f/0x3e099f5ef04ae39e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760696.729051:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000461f5f7f/0x3e099f5ef04ae39e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760696.804413:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967373 is committed 00002000:00010000:3.0:1789760696.804458:0:11798:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 50331648 -> 51380224 00002000:00010000:3.0:1789760696.804463:0:11798:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789760695 -> 1789760696 00002000:00010000:3.0:1789760696.804465:0:11798:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789760695 -> 1789760696 00002000:00010000:3.0:1789760696.804468:0:11798:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 98313 -> 100361 00010000:00010000:3.0:1789760696.804482:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000461f5f7f/0x3e099f5ef04ae39e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760696.804508:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000461f5f7f/0x3e099f5ef04ae39e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760696.804517:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000461f5f7f/0x3e099f5ef04ae39e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760696.804523:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b8200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760696.804528:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000461f5f7f/0x3e099f5ef04ae39e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760696.804536:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000461f5f7f/0x3e099f5ef04ae39e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760696.804553:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000461f5f7f/0x3e099f5ef04ae39e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760696.804560:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000461f5f7f/0x3e099f5ef04ae39e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760696.804649:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d6f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863109632:12345-192.168.203.12@tcp:4:dd.500 Request processed in 75709us (119574us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1789760696.804669:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:3.0:1789760696.804677:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 300841875991 time 300842103683 state 0x2 ref 0 00000100:00100000:1.0:1789760696.811611:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760696.811855:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863109760 00000100:00100000:3.0:1789760696.811876:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863109760 00000100:00100000:3.0:1789760696.811926:0:11799:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 300841875991 time 300842103683 state 0x0 ref 1 00000100:00100000:3.0:1789760696.811940:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 301042103683 time 300842103683 state 0x1 ref 1 00000100:00100000:1.0:1789760696.929761:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 301042103683 time 301042936711 state 0x0 ref 1 00000100:00100000:1.0:1789760696.929823:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863109760:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760696.929904:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 51380224, mtime: 0x6aad94b8, atime: 0x6aad94ae, ctime: 0x6aad94b8, blocks: 0x18809 00010000:00010000:1.0:1789760696.929913:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdbc16e1/0x3e099f5ef04ae3a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760696.929943:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=301s v=(0 0) 00010000:00010000:1.0:1789760696.929948:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760696.929953:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdbc16e1/0x3e099f5ef04ae3a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760696.929969:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cdbc16e1/0x3e099f5ef04ae3a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760697.106564:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967374 is committed 00002000:00010000:1.0:1789760697.109378:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 51380224 -> 52428800 00002000:00010000:1.0:1789760697.109388:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 100361 -> 102409 00010000:00010000:1.0:1789760697.109403:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdbc16e1/0x3e099f5ef04ae3a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760697.109416:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cdbc16e1/0x3e099f5ef04ae3a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760697.109425:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cdbc16e1/0x3e099f5ef04ae3a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760697.109432:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f077e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760697.109437:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdbc16e1/0x3e099f5ef04ae3a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760697.109463:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdbc16e1/0x3e099f5ef04ae3a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760697.109482:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cdbc16e1/0x3e099f5ef04ae3a5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760697.109490:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdbc16e1/0x3e099f5ef04ae3a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760697.109635:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863109760:12345-192.168.203.12@tcp:4:dd.500 Request processed in 179848us (298029us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1789760697.109644:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:1.0:1789760697.109651:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 301042103683 time 301042936711 state 0x2 ref 0 00000100:00100000:0.0:1789760697.134970:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760697.135003:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863109888 00000100:00100000:0.0:1789760697.135012:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863109888 00000100:00100000:0.0:1789760697.135073:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 301042103683 time 301042936711 state 0x0 ref 1 00000100:00100000:0.0:1789760697.135085:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 301242936711 time 301042936711 state 0x1 ref 1 00000100:00100000:0.0:1789760697.135106:0:11801:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 301242936711 time 301248301487 state 0x0 ref 1 00000100:00100000:0.0:1789760697.135117:0:11801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863109888:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760697.135161:0:11801:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 52428800, mtime: 0x6aad94b8, atime: 0x6aad94ae, ctime: 0x6aad94b8, blocks: 0x19009 00010000:00010000:0.0:1789760697.135171:0:11801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae3ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760697.135186:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=301s v=(0 0) 00010000:00010000:0.0:1789760697.135191:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760697.135197:0:11801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae3ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760697.135210:0:11801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae3ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789760697.135396:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789760697.265224:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967375 is committed 00002000:00010000:0.0:1789760697.267025:0:11801:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 52428800 -> 53477376 00002000:00010000:0.0:1789760697.267034:0:11801:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 102409 -> 104457 00010000:00010000:0.0:1789760697.267049:0:11801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae3ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760697.267062:0:11801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae3ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760697.267070:0:11801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae3ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760697.267077:0:11801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760697.267082:0:11801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae3ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760697.267091:0:11801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae3ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760697.267110:0:11801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae3ac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760697.267118:0:11801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae3ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760697.268583:0:11801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863109888:12345-192.168.203.12@tcp:4:dd.500 Request processed in 133458us (133611us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1789760697.269504:0:11801:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:0.0:1789760697.269513:0:11801:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 301242936711 time 301248301487 state 0x2 ref 0 00000100:00100000:3.0:1789760697.280552:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760697.280693:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863110016 00000100:00100000:0.0:1789760697.280703:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863110016 00000100:00100000:0.0:1789760697.280753:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 301242936711 time 301248301487 state 0x0 ref 1 00000100:00100000:0.0:1789760697.280776:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 301448301487 time 301248301487 state 0x1 ref 1 00000100:00100000:1.0:1789760697.338154:0:6698:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 301448301487 time 301451343378 state 0x0 ref 1 00000100:00100000:1.0:1789760697.338181:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14347ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863110016:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760697.338243:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 53477376, mtime: 0x6aad94b8, atime: 0x6aad94ae, ctime: 0x6aad94b8, blocks: 0x19809 00010000:00010000:1.0:1789760697.338252:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdbc16e1/0x3e099f5ef04ae3b3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760697.338269:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=301s v=(0 0) 00010000:00010000:1.0:1789760697.338274:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760697.338280:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdbc16e1/0x3e099f5ef04ae3b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760697.338310:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cdbc16e1/0x3e099f5ef04ae3b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760697.403185:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 53477376 -> 54525952 00002000:00010000:0.0:1789760697.403195:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 104457 -> 106505 00010000:00010000:0.0:1789760697.403210:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdbc16e1/0x3e099f5ef04ae3b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760697.403224:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cdbc16e1/0x3e099f5ef04ae3b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760697.403233:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cdbc16e1/0x3e099f5ef04ae3b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760697.403239:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f077e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760697.403244:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdbc16e1/0x3e099f5ef04ae3b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760697.403272:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdbc16e1/0x3e099f5ef04ae3b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760697.403290:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cdbc16e1/0x3e099f5ef04ae3b3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760697.403298:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdbc16e1/0x3e099f5ef04ae3b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760697.403450:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14347ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+7:2351:x1876699863110016:12345-192.168.203.12@tcp:4:dd.500 Request processed in 65275us (122902us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1789760697.403461:0:6698:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:0.0:1789760697.403469:0:6698:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 301448301487 time 301451343378 state 0x2 ref 0 00000001:00080000:3.0:1789760697.403576:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967376 is committed 00000100:00100000:3.0:1789760697.414698:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760697.414780:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863110144 00000100:00100000:2.0:1789760697.414790:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863110144 00000100:00100000:2.0:1789760697.414864:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 301448301487 time 301451343378 state 0x0 ref 1 00000100:00100000:2.0:1789760697.414877:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 301651343378 time 301451343378 state 0x1 ref 1 00000100:00100000:3.0:1789760697.538635:0:11800:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 301651343378 time 301651821430 state 0x0 ref 1 00000100:00100000:3.0:1789760697.538673:0:11800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14347f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863110144:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760697.538728:0:11800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 54525952, mtime: 0x6aad94b8, atime: 0x6aad94ae, ctime: 0x6aad94b8, blocks: 0x1a009 00010000:00010000:3.0:1789760697.538737:0:11800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071fdf06e/0x3e099f5ef04ae3ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760697.538752:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=301s v=(0 0) 00010000:00010000:3.0:1789760697.538756:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760697.538762:0:11800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071fdf06e/0x3e099f5ef04ae3ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760697.538777:0:11800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071fdf06e/0x3e099f5ef04ae3ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760697.551233:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789760697.553539:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:0.0:1789760697.623266:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967377 is committed 00002000:00010000:0.0:1789760697.623331:0:11800:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 54525952 -> 55574528 00002000:00010000:0.0:1789760697.623336:0:11800:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 106505 -> 108553 00010000:00010000:0.0:1789760697.623349:0:11800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071fdf06e/0x3e099f5ef04ae3ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760697.623377:0:11800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071fdf06e/0x3e099f5ef04ae3ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760697.623387:0:11800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071fdf06e/0x3e099f5ef04ae3ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760697.623412:0:11800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760697.623416:0:11800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071fdf06e/0x3e099f5ef04ae3ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760697.623426:0:11800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071fdf06e/0x3e099f5ef04ae3ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760697.623446:0:11800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071fdf06e/0x3e099f5ef04ae3ba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760697.623454:0:11800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071fdf06e/0x3e099f5ef04ae3ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760697.623541:0:11800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14347f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863110144:12345-192.168.203.12@tcp:4:dd.500 Request processed in 84887us (208848us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1789760697.623551:0:11800:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:0.0:1789760697.623559:0:11800:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 301651343378 time 301651821430 state 0x2 ref 0 00000100:00100000:2.0:1789760697.644320:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760697.644480:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863110272 00000100:00100000:1.0:1789760697.644491:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863110272 00000100:00100000:1.0:1789760697.644546:0:6699:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 301651343378 time 301651821430 state 0x0 ref 1 00000100:00100000:1.0:1789760697.644558:0:6699:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 301851821430 time 301651821430 state 0x1 ref 1 00000100:00100000:0.0:1789760697.738792:0:11801:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 301851821430 time 301851976908 state 0x0 ref 1 00000100:00100000:0.0:1789760697.738865:0:11801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863110272:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760697.739222:0:11801:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 55574528, mtime: 0x6aad94b8, atime: 0x6aad94ae, ctime: 0x6aad94b8, blocks: 0x1a809 00010000:00010000:0.0:1789760697.739232:0:11801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae3c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760697.739267:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=301s v=(0 0) 00010000:00010000:0.0:1789760697.739273:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760697.739279:0:11801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae3c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760697.739363:0:11801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae3c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760697.839690:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967378 is committed 00002000:00010000:0.0:1789760697.839753:0:11801:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 55574528 -> 56623104 00002000:00010000:0.0:1789760697.839757:0:11801:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789760696 -> 1789760697 00002000:00010000:0.0:1789760697.839760:0:11801:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789760696 -> 1789760697 00002000:00010000:0.0:1789760697.839762:0:11801:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 108553 -> 110601 00010000:00010000:0.0:1789760697.839776:0:11801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae3c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760697.839789:0:11801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae3c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760697.839798:0:11801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae3c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760697.839828:0:11801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760697.839833:0:11801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae3c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760697.839867:0:11801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae3c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760697.839900:0:11801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae3c1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760697.839908:0:11801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae3c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760697.840011:0:11801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863110272:12345-192.168.203.12@tcp:4:dd.500 Request processed in 101157us (195695us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1789760697.840020:0:11801:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:0.0:1789760697.840028:0:11801:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 301851821430 time 301851976908 state 0x2 ref 0 00000100:00100000:3.0:1789760697.849093:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760697.849409:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863110400 00000100:00100000:0.0:1789760697.849419:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863110400 00000100:00100000:0.0:1789760697.849480:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 301851821430 time 301851976908 state 0x0 ref 1 00000100:00100000:0.0:1789760697.849494:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 302051976908 time 301851976908 state 0x1 ref 1 00000100:00100000:0.0:1789760697.938975:0:6698:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 302051976908 time 302052159436 state 0x0 ref 1 00000100:00100000:0.0:1789760697.939009:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14347c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863110400:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760697.939065:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 56623104, mtime: 0x6aad94b9, atime: 0x6aad94ae, ctime: 0x6aad94b9, blocks: 0x1b009 00010000:00010000:0.0:1789760697.939074:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae3c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760697.939113:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=302s v=(0 0) 00010000:00010000:0.0:1789760697.939118:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760697.939124:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae3c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760697.939140:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae3c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760697.976243:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760697.976291:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760697.976320:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760697.976341:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760697.976367:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760697.976396:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863110912 00000100:00100000:0.0:1789760697.976405:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863110912 00000100:00100000:0.0:1789760697.976461:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863110784 00000100:00100000:0.0:1789760697.976464:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863110784 00000100:00100000:0.0:1789760697.976487:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:0.0:1789760697.976497:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863110912:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1789760697.976563:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863110912:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 67us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760697.976571:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:0.0:1789760697.976589:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:0.0:1789760697.976596:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+9:2351:x1876699863110784:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1789760697.976621:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+9:2351:x1876699863110784:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760697.976640:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:0.0:1789760697.976672:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863110528 00000100:00100000:0.0:1789760697.976676:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863110528 00000100:00100000:0.0:1789760697.976700:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 257 00000100:00100000:0.0:1789760697.976706:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2351:x1876699863110528:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1789760697.976731:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2351:x1876699863110528:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760697.976738:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 257 00000100:00100000:0.0:1789760697.976780:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863110656 00000100:00100000:0.0:1789760697.976783:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863110656 00000100:00100000:0.0:1789760697.976829:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863111040 00000100:00100000:0.0:1789760697.976832:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863111040 00000100:00100000:0.0:1789760697.976851:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:0.0:1789760697.976858:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+8:2351:x1876699863110656:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1789760697.976887:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+8:2351:x1876699863110656:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 30us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760697.976892:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:0.0:1789760697.976903:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:0.0:1789760697.976909:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2351:x1876699863111040:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1789760697.976945:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2351:x1876699863111040:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 36us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760697.976951:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00080000:0.0:1789760697.976967:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789760697.976971:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789760698.048012:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967379 is committed 00002000:00010000:3.0:1789760698.048397:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 56623104 -> 57671680 00002000:00010000:3.0:1789760698.048415:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 110601 -> 112649 00010000:00010000:3.0:1789760698.048431:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae3c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.048444:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae3c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.048453:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae3c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.048460:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760698.048465:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae3c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.048475:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae3c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.048495:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae3c8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.048503:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae3c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760698.048598:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14347c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863110400:12345-192.168.203.12@tcp:4:dd.500 Request processed in 109600us (199510us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1789760698.048608:0:6698:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 89 00000100:00100000:3.0:1789760698.048616:0:6698:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 302051976908 time 302052159436 state 0x2 ref 0 00000100:00100000:0.0:1789760698.054043:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760698.054147:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863111168 00000100:00100000:2.0:1789760698.054158:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863111168 00000100:00100000:2.0:1789760698.054207:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 302051976908 time 302052159436 state 0x0 ref 1 00000100:00100000:2.0:1789760698.054333:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 302252159436 time 302052159436 state 0x1 ref 1 00000100:00100000:0.0:1789760698.139696:0:11800:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 302252159436 time 302252882130 state 0x0 ref 1 00000100:00100000:0.0:1789760698.139728:0:11800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863111168:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760698.139786:0:11800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 57671680, mtime: 0x6aad94b9, atime: 0x6aad94ae, ctime: 0x6aad94b9, blocks: 0x1b809 00010000:00010000:0.0:1789760698.139795:0:11800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae3cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760698.140019:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=302s v=(0 0) 00010000:00010000:0.0:1789760698.140024:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760698.140031:0:11800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae3cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760698.140047:0:11800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae3cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760698.191852:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967380 is committed 00002000:00010000:3.0:1789760698.192131:0:11800:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 57671680 -> 58720256 00002000:00010000:3.0:1789760698.192137:0:11800:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 112649 -> 114697 00010000:00010000:3.0:1789760698.192150:0:11800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae3cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.192165:0:11800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae3cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.192176:0:11800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae3cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.192183:0:11800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760698.192188:0:11800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae3cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.192198:0:11800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae3cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.192360:0:11800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae3cf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.192369:0:11800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae3cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760698.192485:0:11800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863111168:12345-192.168.203.12@tcp:4:dd.500 Request processed in 52767us (138446us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1789760698.192513:0:11800:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 90 00000100:00100000:3.0:1789760698.192522:0:11800:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 302252159436 time 302252882130 state 0x2 ref 0 00000100:00100000:1.0:1789760698.198602:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760698.198731:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863111296 00000100:00100000:2.0:1789760698.198741:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863111296 00000100:00100000:2.0:1789760698.198798:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 302252159436 time 302252882130 state 0x0 ref 1 00000100:00100000:2.0:1789760698.198835:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 302452882130 time 302252882130 state 0x1 ref 1 00000100:00100000:0.0:1789760698.339988:0:11801:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 302452882130 time 302453173115 state 0x0 ref 1 00000100:00100000:0.0:1789760698.340019:0:11801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863111296:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760698.340087:0:11801:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 58720256, mtime: 0x6aad94b9, atime: 0x6aad94ae, ctime: 0x6aad94b9, blocks: 0x1c009 00010000:00010000:0.0:1789760698.340097:0:11801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae3d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760698.340113:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=302s v=(0 0) 00010000:00010000:0.0:1789760698.340118:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760698.340124:0:11801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae3d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760698.340156:0:11801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae3d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760698.418189:0:11801:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 58720256 -> 59768832 00002000:00010000:3.0:1789760698.418198:0:11801:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 114697 -> 116745 00010000:00010000:3.0:1789760698.418222:0:11801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae3d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.418234:0:11801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae3d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.418244:0:11801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae3d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.418251:0:11801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760698.418257:0:11801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae3d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.418266:0:11801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae3d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.418284:0:11801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae3d6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.418292:0:11801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae3d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760698.418412:0:11801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+7:2351:x1876699863111296:12345-192.168.203.12@tcp:4:dd.500 Request processed in 78404us (219814us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1789760698.418422:0:11801:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 91 00000100:00100000:3.0:1789760698.418430:0:11801:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 302452882130 time 302453173115 state 0x2 ref 0 00000001:00080000:1.0:1789760698.418724:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967381 is committed 00000100:00100000:1.0:1789760698.427880:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760698.428017:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863111424 00000100:00100000:0.0:1789760698.428027:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863111424 00000100:00100000:0.0:1789760698.428084:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 302452882130 time 302453173115 state 0x0 ref 1 00000100:00100000:0.0:1789760698.428098:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 302653173115 time 302453173115 state 0x1 ref 1 00000100:00100000:3.0:1789760698.540444:0:6698:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 302653173115 time 302653629067 state 0x0 ref 1 00000100:00100000:3.0:1789760698.540481:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863111424:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760698.540541:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 59768832, mtime: 0x6aad94b9, atime: 0x6aad94ae, ctime: 0x6aad94b9, blocks: 0x1c809 00010000:00010000:3.0:1789760698.540551:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.540566:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=302s v=(0 0) 00010000:00010000:3.0:1789760698.540570:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760698.540576:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.540592:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760698.579735:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789760698.605616:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967382 is committed 00002000:00010000:3.0:1789760698.605767:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 59768832 -> 60817408 00002000:00010000:3.0:1789760698.605773:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 116745 -> 118793 00010000:00010000:3.0:1789760698.605791:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.605856:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.605961:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.605971:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760698.605976:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.605986:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.606010:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3dd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.606019:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760698.610423:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863111424:12345-192.168.203.12@tcp:4:dd.500 Request processed in 65736us (178339us total) trans 4294967382 rc 0/0 00000100:00100000:3.0:1789760698.610452:0:6698:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:3.0:1789760698.610461:0:6698:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 302653173115 time 302653629067 state 0x2 ref 0 00000100:00100000:1.0:1789760698.611904:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760698.614124:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863111552 00000100:00100000:2.0:1789760698.614137:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863111552 00000100:00100000:2.0:1789760698.614192:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 302653173115 time 302653629067 state 0x0 ref 1 00000100:00100000:2.0:1789760698.614204:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 302853629067 time 302653629067 state 0x1 ref 1 00000100:00100000:3.0:1789760698.741285:0:11800:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 302853629067 time 302854470880 state 0x0 ref 1 00000100:00100000:3.0:1789760698.741339:0:11800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863111552:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760698.741393:0:11800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 60817408, mtime: 0x6aad94b9, atime: 0x6aad94ae, ctime: 0x6aad94b9, blocks: 0x1d009 00010000:00010000:3.0:1789760698.741402:0:11800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.741417:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=302s v=(0 0) 00010000:00010000:3.0:1789760698.741422:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760698.741428:0:11800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.741443:0:11800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760698.862322:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967383 is committed 00002000:00010000:3.0:1789760698.862475:0:11800:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 60817408 -> 61865984 00002000:00010000:3.0:1789760698.862480:0:11800:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789760697 -> 1789760698 00002000:00010000:3.0:1789760698.862482:0:11800:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789760697 -> 1789760698 00002000:00010000:3.0:1789760698.862484:0:11800:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 118793 -> 120841 00010000:00010000:3.0:1789760698.862498:0:11800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.862509:0:11800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.862517:0:11800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.862543:0:11800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760698.862548:0:11800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.862557:0:11800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.862577:0:11800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3e4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.862585:0:11800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760698.862701:0:11800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863111552:12345-192.168.203.12@tcp:4:dd.500 Request processed in 121368us (250800us total) trans 4294967383 rc 0/0 00000100:00100000:3.0:1789760698.862711:0:11800:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:3.0:1789760698.862718:0:11800:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 302853629067 time 302854470880 state 0x2 ref 0 00000100:00100000:1.0:1789760698.868318:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760698.868399:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863111680 00000100:00100000:2.0:1789760698.868409:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863111680 00000100:00100000:2.0:1789760698.868465:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 302853629067 time 302854470880 state 0x0 ref 1 00000100:00100000:2.0:1789760698.868478:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 303054470880 time 302854470880 state 0x1 ref 1 00000100:00100000:3.0:1789760698.941442:0:11801:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 303054470880 time 303054627098 state 0x0 ref 1 00000100:00100000:3.0:1789760698.941478:0:11801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863111680:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760698.941540:0:11801:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 61865984, mtime: 0x6aad94ba, atime: 0x6aad94ae, ctime: 0x6aad94ba, blocks: 0x1d809 00010000:00010000:3.0:1789760698.941550:0:11801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.941584:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=303s v=(0 0) 00010000:00010000:3.0:1789760698.941588:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760698.941594:0:11801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760698.941612:0:11801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760698.959981:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14347ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883041536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789760698.960047:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760698.960127:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883041536 00000100:00100000:0.0:1789760698.960135:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883041536 00000100:00100000:0.0:1789760698.960183:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789760698.960192:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883041536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789760698.960212:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 175439872 pending 1703936 free 3797942272 avail 3795845120 00000100:00100000:0.0:1789760698.960253:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883041536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760698.960260:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1789760698.960281:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760698.960314:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14347ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883041536:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1789760699.017218:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967384 is committed 00002000:00010000:3.0:1789760699.017319:0:11801:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 61865984 -> 62914560 00002000:00010000:3.0:1789760699.017324:0:11801:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 120841 -> 122889 00010000:00010000:3.0:1789760699.017337:0:11801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760699.017350:0:11801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760699.017359:0:11801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760699.017367:0:11801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760699.017372:0:11801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760699.017381:0:11801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760699.017416:0:11801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3eb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760699.017424:0:11801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760699.017523:0:11801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863111680:12345-192.168.203.12@tcp:4:dd.500 Request processed in 76058us (149210us total) trans 4294967384 rc 0/0 00000100:00100000:3.0:1789760699.017533:0:11801:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:3.0:1789760699.017540:0:11801:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 303054470880 time 303054627098 state 0x2 ref 0 00000100:00100000:0.0:1789760699.024010:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760699.024054:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863111808 00000100:00100000:2.0:1789760699.024066:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863111808 00000100:00080000:0.0:1789760699.024126:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760699.024139:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 303054470880 time 303054627098 state 0x0 ref 1 00000100:00100000:2.0:1789760699.024152:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 303254627098 time 303054627098 state 0x1 ref 1 00000100:00100000:2.0:1789760699.141601:0:6698:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 303254627098 time 303254786427 state 0x0 ref 1 00000100:00100000:2.0:1789760699.141634:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863111808:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760699.141727:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 62914560, mtime: 0x6aad94ba, atime: 0x6aad94ae, ctime: 0x6aad94ba, blocks: 0x1e009 00010000:00010000:2.0:1789760699.141737:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae3f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760699.141759:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=303s v=(0 0) 00010000:00010000:2.0:1789760699.141764:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760699.141771:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae3f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760699.141785:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae3f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760699.204785:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967385 is committed 00002000:00010000:0.0:1789760699.205012:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 62914560 -> 63963136 00002000:00010000:0.0:1789760699.205018:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 122889 -> 124937 00010000:00010000:0.0:1789760699.205034:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae3f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760699.205061:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae3f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760699.205071:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae3f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760699.205079:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b8400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760699.205084:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae3f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760699.205094:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae3f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760699.205114:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae3f2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760699.205122:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b36ed793/0x3e099f5ef04ae3f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760699.205214:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863111808:12345-192.168.203.12@tcp:4:dd.500 Request processed in 63591us (181209us total) trans 4294967385 rc 0/0 00000100:00100000:0.0:1789760699.205225:0:6698:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:0.0:1789760699.205233:0:6698:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 303254627098 time 303254786427 state 0x2 ref 0 00000100:00100000:3.0:1789760699.213933:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760699.214101:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863111936 00000100:00100000:2.0:1789760699.214111:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863111936 00000100:00100000:2.0:1789760699.214161:0:11799:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 303254627098 time 303254786427 state 0x0 ref 1 00000100:00100000:2.0:1789760699.214173:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 303454786427 time 303254786427 state 0x1 ref 1 00000100:00100000:3.0:1789760699.343714:0:11800:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 303454786427 time 303456900997 state 0x0 ref 1 00000100:00100000:3.0:1789760699.343752:0:11800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14347ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863111936:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760699.343823:0:11800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 63963136, mtime: 0x6aad94ba, atime: 0x6aad94ae, ctime: 0x6aad94ba, blocks: 0x1e809 00010000:00010000:3.0:1789760699.343838:0:11800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760699.343865:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=303s v=(0 0) 00010000:00010000:3.0:1789760699.343882:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760699.343891:0:11800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760699.343905:0:11800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760699.450521:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967386 is committed 00002000:00010000:2.0:1789760699.450595:0:11800:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 63963136 -> 65011712 00002000:00010000:2.0:1789760699.450600:0:11800:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 124937 -> 126985 00010000:00010000:2.0:1789760699.450613:0:11800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760699.450626:0:11800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760699.450636:0:11800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760699.450666:0:11800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760699.450671:0:11800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760699.450681:0:11800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760699.450699:0:11800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760699.450708:0:11800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae3f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760699.451189:0:11800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14347ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863111936:12345-192.168.203.12@tcp:4:dd.500 Request processed in 107447us (237260us total) trans 4294967386 rc 0/0 00000100:00100000:2.0:1789760699.451200:0:11800:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 96 00000100:00100000:2.0:1789760699.451208:0:11800:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 303454786427 time 303456900997 state 0x2 ref 0 00000100:00100000:2.0:1789760699.458507:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760699.458702:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863112064 00000100:00100000:0.0:1789760699.458724:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863112064 00000100:00100000:0.0:1789760699.458796:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 303454786427 time 303456900997 state 0x0 ref 1 00000100:00100000:0.0:1789760699.458985:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 303656900997 time 303456900997 state 0x1 ref 1 00000100:00100000:3.0:1789760699.545979:0:11801:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 303656900997 time 303659165543 state 0x0 ref 1 00000100:00100000:3.0:1789760699.546014:0:11801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863112064:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760699.546074:0:11801:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 65011712, mtime: 0x6aad94ba, atime: 0x6aad94ae, ctime: 0x6aad94ba, blocks: 0x1f009 00010000:00010000:3.0:1789760699.546084:0:11801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096f1774f/0x3e099f5ef04ae400 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760699.546099:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=303s v=(0 0) 00010000:00010000:3.0:1789760699.546103:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760699.546109:0:11801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096f1774f/0x3e099f5ef04ae400 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760699.546124:0:11801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096f1774f/0x3e099f5ef04ae400 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760699.599103:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789760699.608129:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967387 is committed 00002000:00010000:0.0:1789760699.608228:0:11801:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 65011712 -> 66060288 00002000:00010000:0.0:1789760699.608234:0:11801:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 126985 -> 129033 00010000:00010000:0.0:1789760699.608249:0:11801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096f1774f/0x3e099f5ef04ae400 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760699.608262:0:11801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096f1774f/0x3e099f5ef04ae400 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760699.608271:0:11801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096f1774f/0x3e099f5ef04ae400 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760699.608278:0:11801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760699.608282:0:11801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096f1774f/0x3e099f5ef04ae400 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760699.608302:0:11801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096f1774f/0x3e099f5ef04ae400 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760699.608322:0:11801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096f1774f/0x3e099f5ef04ae400 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760699.608330:0:11801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096f1774f/0x3e099f5ef04ae400 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760699.608444:0:11801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863112064:12345-192.168.203.12@tcp:4:dd.500 Request processed in 62443us (149941us total) trans 4294967387 rc 0/0 00000100:00100000:0.0:1789760699.608455:0:11801:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:0.0:1789760699.608462:0:11801:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 303656900997 time 303659165543 state 0x2 ref 0 00000100:00100000:1.0:1789760699.615241:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760699.615549:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863112192 00000100:00100000:3.0:1789760699.615559:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863112192 00000100:00100000:3.0:1789760699.615613:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 303656900997 time 303659165543 state 0x0 ref 1 00000100:00100000:3.0:1789760699.615626:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 303859165543 time 303659165543 state 0x1 ref 1 00000100:00100000:0.0:1789760699.746187:0:6698:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 303859165543 time 303859363376 state 0x0 ref 1 00000100:00100000:0.0:1789760699.746222:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863112192:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760699.746277:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 66060288, mtime: 0x6aad94ba, atime: 0x6aad94ae, ctime: 0x6aad94ba, blocks: 0x1f809 00010000:00010000:0.0:1789760699.746286:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059a05cf5/0x3e099f5ef04ae407 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760699.746302:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=303s v=(0 0) 00010000:00010000:0.0:1789760699.746307:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760699.746313:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059a05cf5/0x3e099f5ef04ae407 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760699.746328:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059a05cf5/0x3e099f5ef04ae407 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760699.800216:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967388 is committed 00002000:00010000:2.0:1789760699.801895:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 66060288 -> 67108864 00002000:00010000:2.0:1789760699.801902:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789760698 -> 1789760699 00002000:00010000:2.0:1789760699.801906:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789760698 -> 1789760699 00002000:00010000:2.0:1789760699.801908:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 129033 -> 131081 00010000:00010000:2.0:1789760699.801923:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059a05cf5/0x3e099f5ef04ae407 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760699.801956:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059a05cf5/0x3e099f5ef04ae407 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760699.801965:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059a05cf5/0x3e099f5ef04ae407 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760699.801973:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760699.801978:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059a05cf5/0x3e099f5ef04ae407 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760699.801987:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059a05cf5/0x3e099f5ef04ae407 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760699.802009:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059a05cf5/0x3e099f5ef04ae407 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760699.802018:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059a05cf5/0x3e099f5ef04ae407 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760699.802131:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863112192:12345-192.168.203.12@tcp:4:dd.500 Request processed in 55919us (186894us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1789760699.802141:0:6698:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:2.0:1789760699.802148:0:6698:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 303859165543 time 303859363376 state 0x2 ref 0 00000100:00100000:1.0:1789760699.809693:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760699.810752:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863112320 00000100:00100000:2.0:1789760699.810774:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863112320 00000100:00100000:2.0:1789760699.810866:0:11799:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 303859165543 time 303859363376 state 0x0 ref 1 00000100:00100000:2.0:1789760699.810880:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 304059363376 time 303859363376 state 0x1 ref 1 00000100:00100000:2.0:1789760699.947993:0:11800:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 304059363376 time 304061179743 state 0x0 ref 1 00000100:00100000:2.0:1789760699.948023:0:11800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863112320:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760699.948074:0:11800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 67108864, mtime: 0x6aad94bb, atime: 0x6aad94ae, ctime: 0x6aad94bb, blocks: 0x20009 00010000:00010000:2.0:1789760699.948083:0:11800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da1a82bd/0x3e099f5ef04ae40e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760699.948099:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=304s v=(0 0) 00010000:00010000:2.0:1789760699.948103:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760699.948108:0:11800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da1a82bd/0x3e099f5ef04ae40e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760699.948123:0:11800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da1a82bd/0x3e099f5ef04ae40e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760700.034669:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967389 is committed 00002000:00010000:1.0:1789760700.039308:0:11800:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 67108864 -> 68157440 00002000:00010000:1.0:1789760700.039319:0:11800:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 131081 -> 133129 00010000:00010000:1.0:1789760700.039334:0:11800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da1a82bd/0x3e099f5ef04ae40e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.039368:0:11800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da1a82bd/0x3e099f5ef04ae40e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.039377:0:11800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da1a82bd/0x3e099f5ef04ae40e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.039384:0:11800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b8000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760700.039389:0:11800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da1a82bd/0x3e099f5ef04ae40e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.039399:0:11800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da1a82bd/0x3e099f5ef04ae40e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.039419:0:11800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da1a82bd/0x3e099f5ef04ae40e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.039426:0:11800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da1a82bd/0x3e099f5ef04ae40e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760700.039540:0:11800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863112320:12345-192.168.203.12@tcp:4:dd.500 Request processed in 91526us (229850us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1789760700.039550:0:11800:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 99 00000100:00100000:1.0:1789760700.039558:0:11800:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 304059363376 time 304061179743 state 0x2 ref 0 00000100:00100000:0.0:1789760700.046843:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760700.046974:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863112448 00000100:00100000:1.0:1789760700.046996:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863112448 00000100:00100000:1.0:1789760700.047048:0:6699:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 304059363376 time 304061179743 state 0x0 ref 1 00000100:00100000:1.0:1789760700.047062:0:6699:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 304261179743 time 304061179743 state 0x1 ref 1 00000100:00100000:0.0:1789760700.151610:0:11801:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 304261179743 time 304264796690 state 0x0 ref 1 00000100:00100000:0.0:1789760700.151761:0:11801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863112448:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760700.151897:0:11801:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 68157440, mtime: 0x6aad94bb, atime: 0x6aad94ae, ctime: 0x6aad94bb, blocks: 0x20809 00010000:00010000:0.0:1789760700.151907:0:11801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae415 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760700.151922:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=304s v=(0 0) 00010000:00010000:0.0:1789760700.151926:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760700.151932:0:11801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae415 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760700.151946:0:11801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae415 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760700.195750:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967390 is committed 00002000:00010000:1.0:1789760700.195848:0:11801:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 68157440 -> 69206016 00002000:00010000:1.0:1789760700.195862:0:11801:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 133129 -> 135177 00010000:00010000:1.0:1789760700.195884:0:11801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae415 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.195897:0:11801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae415 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.195905:0:11801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae415 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.195911:0:11801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760700.195915:0:11801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae415 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.195924:0:11801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae415 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.195945:0:11801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae415 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.195952:0:11801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04ae415 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760700.196075:0:11801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863112448:12345-192.168.203.12@tcp:4:dd.500 Request processed in 44445us (149277us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1789760700.196086:0:11801:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:1.0:1789760700.196093:0:11801:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 304261179743 time 304264796690 state 0x2 ref 0 00000100:00100000:1.0:1789760700.202462:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760700.202545:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863112576 00000100:00100000:2.0:1789760700.202556:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863112576 00000100:00100000:2.0:1789760700.202613:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 304261179743 time 304264796690 state 0x0 ref 1 00000100:00100000:2.0:1789760700.202625:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 304464796690 time 304264796690 state 0x1 ref 1 00000100:00100000:2.0:1789760700.351753:0:6698:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 304464796690 time 304464937767 state 0x0 ref 1 00000100:00100000:2.0:1789760700.351792:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d367800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863112576:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760700.351879:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 69206016, mtime: 0x6aad94bb, atime: 0x6aad94ae, ctime: 0x6aad94bb, blocks: 0x21009 00010000:00010000:2.0:1789760700.351888:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb76d6dc/0x3e099f5ef04ae41c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760700.351904:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=304s v=(0 0) 00010000:00010000:2.0:1789760700.351908:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760700.351915:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb76d6dc/0x3e099f5ef04ae41c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760700.351928:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb76d6dc/0x3e099f5ef04ae41c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760700.416587:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967391 is committed 00002000:00010000:1.0:1789760700.416727:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 69206016 -> 70254592 00002000:00010000:1.0:1789760700.416732:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 135177 -> 137225 00010000:00010000:1.0:1789760700.416745:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb76d6dc/0x3e099f5ef04ae41c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.416758:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb76d6dc/0x3e099f5ef04ae41c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.416765:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb76d6dc/0x3e099f5ef04ae41c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.416772:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b9c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760700.416777:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb76d6dc/0x3e099f5ef04ae41c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.416785:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb76d6dc/0x3e099f5ef04ae41c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.416830:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb76d6dc/0x3e099f5ef04ae41c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.416862:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb76d6dc/0x3e099f5ef04ae41c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760700.416964:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d367800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863112576:12345-192.168.203.12@tcp:4:dd.500 Request processed in 65180us (214506us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1789760700.416975:0:6698:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 101 00000100:00100000:1.0:1789760700.416983:0:6698:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 304464796690 time 304464937767 state 0x2 ref 0 00000100:00100000:2.0:1789760700.437087:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760700.437319:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863112704 00000100:00100000:3.0:1789760700.437330:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863112704 00000100:00100000:3.0:1789760700.437381:0:11799:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 304464796690 time 304464937767 state 0x0 ref 1 00000100:00100000:3.0:1789760700.437393:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 304664937767 time 304464937767 state 0x1 ref 1 00000100:00100000:2.0:1789760700.495276:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14347ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876699883041792:0@lo:400:kworker.0 00000100:00100000:2.0:1789760700.495346:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760700.495440:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789760700.495455:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14347c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699883041664:0@lo:400:kworker.0 00000100:00100000:0.0:1789760700.495491:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760700.495545:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883041664 00000100:00100000:0.0:1789760700.495552:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883041664 00000100:00100000:0.0:1789760700.495594:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789760700.495603:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:3308:x1876699883041664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760700.495661:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:3308:x1876699883041664:12345-0@lo:400:kworker.0 Request processed in 59us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760700.495668:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789760700.495698:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883041792 00000100:00100000:0.0:1789760700.495702:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883041792 00000100:00100000:0.0:1789760700.495728:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789760700.495734:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d6f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876699883041792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760700.496055:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14347d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1876699883041920:0@lo:400:kworker.0 00000100:00100000:1.0:1789760700.496100:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760700.496136:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883041920 00000100:00100000:1.0:1789760700.496140:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883041920 00000100:00100000:1.0:1789760700.496178:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789760700.496188:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876699883041920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760700.496224:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876699883041920:12345-0@lo:400:kworker.0 Request processed in 39us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760700.496231:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:1.0:1789760700.496248:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760700.496277:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14347d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1876699883041920:0@lo:400:kworker.0 00000100:00100000:0.0:1789760700.497278:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d6f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876699883041792:12345-0@lo:400:kworker.0 Request processed in 1539us (1927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760700.497289:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789760700.497339:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14347c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699883041664:0@lo:400:kworker.0 00000100:00100000:1.0:1789760700.498207:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14347c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1876699883042176:0@lo:400:kworker.0 00000100:00100000:1.0:1789760700.498259:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760700.498294:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789760700.498300:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14347dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883042048:0@lo:400:kworker.0 00000100:00100000:1.0:1789760700.498324:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760700.498367:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883042048 00000100:00100000:1.0:1789760700.498374:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883042048 00000100:00100000:1.0:1789760700.498421:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789760700.498430:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883042048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760700.498477:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883042048:12345-0@lo:400:kworker.0 Request processed in 48us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760700.498484:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1789760700.498505:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760700.498512:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789760700.498519:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14347c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883042304:0@lo:400:kworker.0 00000100:00100000:1.0:1789760700.498542:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760700.498566:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883042304 00000100:00100000:1.0:1789760700.498569:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883042304 00000100:00100000:1.0:1789760700.498597:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789760700.498604:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883042304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760700.498647:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883042304:12345-0@lo:400:kworker.0 Request processed in 44us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760700.498654:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1789760700.498671:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789760700.498689:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:1.0:1789760700.498694:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df142e42300, transno 4294967323 00000100:00100000:1.0:1789760700.498706:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14347c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883042304:0@lo:400:kworker.0 00000100:00100000:1.0:1789760700.499212:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14347dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883042048:0@lo:400:kworker.0 00000100:00100000:3.0:1789760700.499401:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883042176 00000100:00100000:3.0:1789760700.499407:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883042176 00000100:00100000:3.0:1789760700.499458:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789760700.499465:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876699883042176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760700.499508:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876699883042176:12345-0@lo:400:kworker.0 Request processed in 43us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760700.499515:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:1.0:1789760700.500294:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760700.500325:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14347c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1876699883042176:0@lo:400:kworker.0 00000100:00100000:2.0:1789760700.500649:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14347ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876699883041792:0@lo:400:kworker.0 00000100:00100000:1.0:1789760700.553651:0:11800:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 304664937767 time 304666826600 state 0x0 ref 1 00000100:00100000:1.0:1789760700.553703:0:11800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d6f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863112704:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760700.553762:0:11800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 70254592, mtime: 0x6aad94bb, atime: 0x6aad94ae, ctime: 0x6aad94bb, blocks: 0x21809 00010000:00010000:1.0:1789760700.553771:0:11800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae423 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.553787:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=304s v=(0 0) 00010000:00010000:1.0:1789760700.553792:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760700.553798:0:11800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae423 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.553888:0:11800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae423 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760700.597208:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967392 is committed 00002000:00010000:1.0:1789760700.597317:0:11800:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 70254592 -> 71303168 00002000:00010000:1.0:1789760700.597322:0:11800:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 137225 -> 139273 00010000:00010000:1.0:1789760700.597335:0:11800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae423 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.597348:0:11800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae423 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.597357:0:11800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae423 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.597364:0:11800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760700.597368:0:11800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae423 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.597391:0:11800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae423 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.597411:0:11800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae423 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.597419:0:11800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae423 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760700.597553:0:11800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d6f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863112704:12345-192.168.203.12@tcp:4:dd.500 Request processed in 43859us (160469us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1789760700.597564:0:11800:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 102 00000100:00100000:1.0:1789760700.597573:0:11800:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 304664937767 time 304666826600 state 0x2 ref 0 00000100:00100000:2.0:1789760700.605231:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760700.606933:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863112832 00000100:00100000:1.0:1789760700.606946:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863112832 00000100:00100000:1.0:1789760700.607072:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 304664937767 time 304666826600 state 0x0 ref 1 00000100:00100000:1.0:1789760700.607086:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 304866826600 time 304666826600 state 0x1 ref 1 00010000:00010000:0.0:1789760700.623458:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760700.753779:0:11801:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 304866826600 time 304866964721 state 0x0 ref 1 00000100:00100000:1.0:1789760700.753848:0:11801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d6f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863112832:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760700.753911:0:11801:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 71303168, mtime: 0x6aad94bb, atime: 0x6aad94ae, ctime: 0x6aad94bb, blocks: 0x22009 00010000:00010000:1.0:1789760700.753920:0:11801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae42a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.753948:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=304s v=(0 0) 00010000:00010000:1.0:1789760700.753953:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760700.753959:0:11801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae42a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.753972:0:11801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae42a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760700.855739:0:11801:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 71303168 -> 72351744 00002000:00010000:1.0:1789760700.855749:0:11801:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 139273 -> 141321 00010000:00010000:1.0:1789760700.855763:0:11801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae42a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.855776:0:11801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae42a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.855786:0:11801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae42a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.855793:0:11801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760700.855798:0:11801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae42a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.855835:0:11801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae42a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.855939:0:11801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae42a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.855948:0:11801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae42a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760700.856037:0:11801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d6f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+7:2348:x1876699863112832:12345-192.168.203.12@tcp:4:dd.500 Request processed in 102237us (250812us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1789760700.856048:0:11801:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 103 00000100:00100000:1.0:1789760700.856056:0:11801:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 304866826600 time 304866964721 state 0x2 ref 0 00000001:00080000:3.0:1789760700.856469:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967393 is committed 00000100:00100000:0.0:1789760700.865271:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760700.865403:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863112960 00000100:00100000:2.0:1789760700.865414:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863112960 00000100:00100000:2.0:1789760700.867039:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 304866826600 time 304866964721 state 0x0 ref 1 00000100:00100000:2.0:1789760700.867061:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 305066964721 time 304866964721 state 0x1 ref 1 00000100:00100000:1.0:1789760700.953930:0:6698:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 305066964721 time 305067113762 state 0x0 ref 1 00000100:00100000:1.0:1789760700.953967:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863112960:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760700.954023:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 72351744, mtime: 0x6aad94bb, atime: 0x6aad94ae, ctime: 0x6aad94bb, blocks: 0x22809 00010000:00010000:1.0:1789760700.954032:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae431 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.954048:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=305s v=(0 0) 00010000:00010000:1.0:1789760700.954053:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760700.954169:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae431 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760700.954189:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae431 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760701.007046:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789760701.007075:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14347d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883042432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760701.007140:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760701.007272:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883042432 00000100:00100000:0.0:1789760701.007280:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883042432 00000100:00100000:0.0:1789760701.007338:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789760701.007350:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d6f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883042432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789760701.007382:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 71499776 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760701.007435:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d6f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883042432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760701.007443:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789760701.007488:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14347d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883042432:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1789760701.038914:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967394 is committed 00002000:00010000:3.0:1789760701.039084:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 72351744 -> 73400320 00002000:00010000:3.0:1789760701.039089:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789760699 -> 1789760700 00002000:00010000:3.0:1789760701.039092:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789760699 -> 1789760700 00002000:00010000:3.0:1789760701.039095:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 141321 -> 143369 00010000:00010000:3.0:1789760701.039107:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae431 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760701.039120:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae431 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760701.039130:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae431 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760701.039136:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760701.039141:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae431 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760701.039150:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae431 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760701.039192:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae431 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760701.039200:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae431 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760701.039298:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863112960:12345-192.168.203.12@tcp:4:dd.500 Request processed in 85344us (174032us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1789760701.039308:0:6698:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:3.0:1789760701.039316:0:6698:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 305066964721 time 305067113762 state 0x2 ref 0 00000100:00100000:0.0:1789760701.050217:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760701.050336:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863113088 00000100:00100000:3.0:1789760701.050346:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863113088 00000100:00100000:3.0:1789760701.050418:0:11799:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 305066964721 time 305067113762 state 0x0 ref 1 00000100:00100000:3.0:1789760701.050431:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 305267113762 time 305067113762 state 0x1 ref 1 00000100:00080000:1.0:1789760701.050514:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760701.159601:0:11800:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 305267113762 time 305272785941 state 0x0 ref 1 00000100:00100000:1.0:1789760701.159756:0:11800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863113088:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760701.159941:0:11800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 73400320, mtime: 0x6aad94bc, atime: 0x6aad94ae, ctime: 0x6aad94bc, blocks: 0x23009 00010000:00010000:1.0:1789760701.159950:0:11800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae438 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760701.159966:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=305s v=(0 0) 00010000:00010000:1.0:1789760701.159971:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760701.159977:0:11800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae438 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760701.159992:0:11800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae438 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760701.231148:0:11800:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 73400320 -> 74448896 00002000:00010000:1.0:1789760701.231156:0:11800:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 143369 -> 145417 00010000:00010000:1.0:1789760701.231172:0:11800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae438 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760701.231186:0:11800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae438 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760701.231195:0:11800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae438 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760701.231215:0:11800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f077600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760701.231221:0:11800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae438 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760701.231231:0:11800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae438 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760701.231250:0:11800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae438 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760701.231258:0:11800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae438 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760701.231358:0:11800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+7:2348:x1876699863113088:12345-192.168.203.12@tcp:4:dd.500 Request processed in 71733us (181146us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1789760701.231377:0:11800:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 105 00000100:00100000:1.0:1789760701.231384:0:11800:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 305267113762 time 305272785941 state 0x2 ref 0 00000001:00080000:2.0:1789760701.231523:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967395 is committed 00000100:00100000:0.0:1789760701.244305:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760701.244498:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863113216 00000100:00100000:2.0:1789760701.244509:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863113216 00000100:00100000:2.0:1789760701.244563:0:6699:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 305267113762 time 305272785941 state 0x0 ref 1 00000100:00100000:2.0:1789760701.244576:0:6699:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 305472785941 time 305272785941 state 0x1 ref 1 00000100:00100000:1.0:1789760701.359839:0:11801:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 305472785941 time 305473023454 state 0x0 ref 1 00000100:00100000:1.0:1789760701.360003:0:11801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863113216:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760701.360063:0:11801:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 74448896, mtime: 0x6aad94bc, atime: 0x6aad94ae, ctime: 0x6aad94bc, blocks: 0x23809 00010000:00010000:1.0:1789760701.360073:0:11801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae43f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760701.360106:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=305s v=(0 0) 00010000:00010000:1.0:1789760701.360110:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760701.360116:0:11801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae43f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760701.360129:0:11801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae43f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760701.462167:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967396 is committed 00002000:00010000:0.0:1789760701.462410:0:11801:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 74448896 -> 75497472 00002000:00010000:0.0:1789760701.462415:0:11801:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 145417 -> 147465 00010000:00010000:0.0:1789760701.462429:0:11801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae43f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760701.462443:0:11801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae43f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760701.462471:0:11801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae43f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760701.462479:0:11801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f077600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760701.462484:0:11801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae43f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760701.462494:0:11801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae43f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760701.462513:0:11801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae43f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760701.462521:0:11801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae43f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760701.462620:0:11801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863113216:12345-192.168.203.12@tcp:4:dd.500 Request processed in 102694us (218317us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1789760701.462640:0:11801:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 106 00000100:00100000:0.0:1789760701.462648:0:11801:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 305472785941 time 305473023454 state 0x2 ref 0 00000100:00100000:0.0:1789760701.474151:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760701.474248:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863113344 00000100:00100000:2.0:1789760701.474276:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863113344 00000100:00100000:2.0:1789760701.474358:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 305472785941 time 305473023454 state 0x0 ref 1 00000100:00100000:2.0:1789760701.474371:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 305673023454 time 305473023454 state 0x1 ref 1 00000100:00100000:3.0:1789760701.562145:0:6698:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 305673023454 time 305675330571 state 0x0 ref 1 00000100:00100000:3.0:1789760701.562181:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863113344:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760701.562238:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 75497472, mtime: 0x6aad94bc, atime: 0x6aad94ae, ctime: 0x6aad94bc, blocks: 0x24009 00010000:00010000:3.0:1789760701.562246:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae446 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760701.562263:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=305s v=(0 0) 00010000:00010000:3.0:1789760701.562268:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760701.562287:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae446 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760701.562301:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae446 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760701.647499:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789760701.654197:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967397 is committed 00002000:00010000:0.0:1789760701.654511:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 75497472 -> 76546048 00002000:00010000:0.0:1789760701.654516:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 147465 -> 149513 00010000:00010000:0.0:1789760701.654531:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae446 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760701.654557:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae446 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760701.654566:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae446 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760701.654573:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241675a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760701.654578:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae446 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760701.654587:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae446 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760701.654605:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae446 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760701.654613:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae446 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760701.654757:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863113344:12345-192.168.203.12@tcp:4:dd.500 Request processed in 92587us (180610us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1789760701.654767:0:6698:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 107 00000100:00100000:0.0:1789760701.654775:0:6698:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 305673023454 time 305675330571 state 0x2 ref 0 00000100:00100000:2.0:1789760701.674098:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760701.680127:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863113472 00000100:00100000:3.0:1789760701.680142:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863113472 00000100:00100000:3.0:1789760701.680201:0:11799:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 305673023454 time 305675330571 state 0x0 ref 1 00000100:00100000:3.0:1789760701.680214:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 305875330571 time 305675330571 state 0x1 ref 1 00000100:00100000:1.0:1789760701.765272:0:11800:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 305875330571 time 305878457512 state 0x0 ref 1 00000100:00100000:1.0:1789760701.765310:0:11800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d6f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863113472:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760701.765372:0:11800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 76546048, mtime: 0x6aad94bc, atime: 0x6aad94ae, ctime: 0x6aad94bc, blocks: 0x24809 00010000:00010000:1.0:1789760701.765382:0:11800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079e1b49a/0x3e099f5ef04ae44d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760701.765400:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=305s v=(0 0) 00010000:00010000:1.0:1789760701.765405:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760701.765411:0:11800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079e1b49a/0x3e099f5ef04ae44d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760701.765425:0:11800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079e1b49a/0x3e099f5ef04ae44d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760701.844179:0:11800:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 76546048 -> 77594624 00002000:00010000:1.0:1789760701.844201:0:11800:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789760700 -> 1789760701 00002000:00010000:1.0:1789760701.844204:0:11800:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789760700 -> 1789760701 00002000:00010000:1.0:1789760701.844206:0:11800:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 149513 -> 151561 00010000:00010000:1.0:1789760701.844222:0:11800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079e1b49a/0x3e099f5ef04ae44d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760701.844236:0:11800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079e1b49a/0x3e099f5ef04ae44d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760701.844245:0:11800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079e1b49a/0x3e099f5ef04ae44d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760701.844251:0:11800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f077400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760701.844256:0:11800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079e1b49a/0x3e099f5ef04ae44d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760701.844265:0:11800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079e1b49a/0x3e099f5ef04ae44d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760701.844285:0:11800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079e1b49a/0x3e099f5ef04ae44d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760701.844292:0:11800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079e1b49a/0x3e099f5ef04ae44d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760701.844381:0:11800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d6f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+7:2351:x1876699863113472:12345-192.168.203.12@tcp:4:dd.500 Request processed in 79086us (170288us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1789760701.844401:0:11800:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 108 00000100:00100000:1.0:1789760701.844409:0:11800:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 305875330571 time 305878457512 state 0x2 ref 0 00000001:00080000:2.0:1789760701.844608:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967398 is committed 00000100:00100000:0.0:1789760701.853119:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760701.853243:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863113600 00000100:00100000:1.0:1789760701.853255:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863113600 00000100:00100000:1.0:1789760701.853310:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 305875330571 time 305878457512 state 0x0 ref 1 00000100:00100000:1.0:1789760701.853324:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 306078457512 time 305878457512 state 0x1 ref 1 00000100:00100000:0.0:1789760701.965516:0:11801:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 306078457512 time 306078700173 state 0x0 ref 1 00000100:00100000:0.0:1789760701.965552:0:11801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863113600:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760701.965614:0:11801:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 77594624, mtime: 0x6aad94bd, atime: 0x6aad94ae, ctime: 0x6aad94bd, blocks: 0x25009 00010000:00010000:0.0:1789760701.965634:0:11801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae454 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760701.965652:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=306s v=(0 0) 00010000:00010000:0.0:1789760701.965657:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760701.965663:0:11801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae454 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760701.965681:0:11801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae454 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760702.045079:0:11801:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 77594624 -> 78643200 00002000:00010000:1.0:1789760702.045089:0:11801:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 151561 -> 153609 00010000:00010000:1.0:1789760702.045105:0:11801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae454 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760702.045119:0:11801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae454 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760702.045127:0:11801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae454 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760702.045144:0:11801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760702.045149:0:11801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae454 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760702.045159:0:11801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae454 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760702.045177:0:11801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae454 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760702.045199:0:11801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae454 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760702.045302:0:11801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+7:2348:x1876699863113600:12345-192.168.203.12@tcp:4:dd.500 Request processed in 79763us (192188us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1789760702.045313:0:11801:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 109 00000100:00100000:1.0:1789760702.045322:0:11801:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 306078457512 time 306078700173 state 0x2 ref 0 00000001:00080000:1.0:1789760702.045371:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967399 is committed 00000100:00100000:0.0:1789760702.059989:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760702.060109:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863113728 00000100:00100000:2.0:1789760702.060119:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863113728 00000100:00100000:2.0:1789760702.060241:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 306078457512 time 306078700173 state 0x0 ref 1 00000100:00100000:2.0:1789760702.060255:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 306278700173 time 306078700173 state 0x1 ref 1 00000100:00100000:0.0:1789760702.165679:0:6698:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 306278700173 time 306278864227 state 0x0 ref 1 00000100:00100000:0.0:1789760702.165713:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863113728:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760702.165788:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 78643200, mtime: 0x6aad94bd, atime: 0x6aad94ae, ctime: 0x6aad94bd, blocks: 0x25809 00010000:00010000:0.0:1789760702.165797:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae45b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760702.165837:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=306s v=(0 0) 00010000:00010000:0.0:1789760702.165842:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760702.165848:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae45b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760702.165876:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae45b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760702.276530:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967400 is committed 00002000:00010000:3.0:1789760702.276682:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 78643200 -> 79691776 00002000:00010000:3.0:1789760702.276686:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 153609 -> 155657 00010000:00010000:3.0:1789760702.276699:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae45b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760702.276711:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae45b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760702.276720:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae45b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760702.276727:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760702.276732:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae45b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760702.276741:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae45b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760702.276787:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae45b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760702.276795:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae45b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760702.276930:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863113728:12345-192.168.203.12@tcp:4:dd.500 Request processed in 111230us (216948us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1789760702.276941:0:6698:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 110 00000100:00100000:3.0:1789760702.276948:0:6698:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 306278700173 time 306278864227 state 0x2 ref 0 00000100:00100000:0.0:1789760702.290521:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760702.290681:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863113856 00000100:00100000:3.0:1789760702.290691:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863113856 00000100:00100000:3.0:1789760702.290744:0:11799:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 306278700173 time 306278864227 state 0x0 ref 1 00000100:00100000:3.0:1789760702.290757:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 306478864227 time 306278864227 state 0x1 ref 1 00000100:00100000:1.0:1789760702.365889:0:11800:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 306478864227 time 306479073951 state 0x0 ref 1 00000100:00100000:1.0:1789760702.365931:0:11800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863113856:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760702.365991:0:11800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 79691776, mtime: 0x6aad94bd, atime: 0x6aad94ae, ctime: 0x6aad94bd, blocks: 0x26009 00010000:00010000:1.0:1789760702.365999:0:11800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b9e0ed3/0x3e099f5ef04ae462 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760702.366021:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=306s v=(0 0) 00010000:00010000:1.0:1789760702.366026:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760702.366032:0:11800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b9e0ed3/0x3e099f5ef04ae462 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760702.366045:0:11800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b9e0ed3/0x3e099f5ef04ae462 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760702.454931:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967401 is committed 00002000:00010000:3.0:1789760702.455037:0:11800:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 79691776 -> 80740352 00002000:00010000:3.0:1789760702.455043:0:11800:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 155657 -> 157705 00010000:00010000:3.0:1789760702.455057:0:11800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b9e0ed3/0x3e099f5ef04ae462 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760702.455071:0:11800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b9e0ed3/0x3e099f5ef04ae462 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760702.455080:0:11800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b9e0ed3/0x3e099f5ef04ae462 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760702.455105:0:11800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760702.455110:0:11800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b9e0ed3/0x3e099f5ef04ae462 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760702.455119:0:11800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b9e0ed3/0x3e099f5ef04ae462 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760702.455139:0:11800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b9e0ed3/0x3e099f5ef04ae462 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760702.455146:0:11800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b9e0ed3/0x3e099f5ef04ae462 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760702.455238:0:11800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863113856:12345-192.168.203.12@tcp:4:dd.500 Request processed in 89325us (164721us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1789760702.455248:0:11800:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 111 00000100:00100000:3.0:1789760702.455256:0:11800:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 306478864227 time 306479073951 state 0x2 ref 0 00000100:00100000:1.0:1789760702.462175:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760702.462329:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863113984 00000100:00100000:2.0:1789760702.462427:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863113984 00000100:00100000:2.0:1789760702.462484:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 306478864227 time 306479073951 state 0x0 ref 1 00000100:00100000:2.0:1789760702.462498:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 306679073951 time 306479073951 state 0x1 ref 1 00000100:00100000:0.0:1789760702.565992:0:11801:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 306679073951 time 306679173749 state 0x0 ref 1 00000100:00100000:0.0:1789760702.566026:0:11801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863113984:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760702.566084:0:11801:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 80740352, mtime: 0x6aad94bd, atime: 0x6aad94ae, ctime: 0x6aad94bd, blocks: 0x26809 00010000:00010000:0.0:1789760702.566093:0:11801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045c63bcc/0x3e099f5ef04ae469 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760702.566108:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=306s v=(0 0) 00010000:00010000:0.0:1789760702.566112:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760702.566119:0:11801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045c63bcc/0x3e099f5ef04ae469 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760702.566132:0:11801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045c63bcc/0x3e099f5ef04ae469 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760702.610773:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967402 is committed 00002000:00010000:3.0:1789760702.610911:0:11801:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 80740352 -> 81788928 00002000:00010000:3.0:1789760702.610916:0:11801:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 157705 -> 159753 00010000:00010000:3.0:1789760702.610930:0:11801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045c63bcc/0x3e099f5ef04ae469 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760702.610943:0:11801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045c63bcc/0x3e099f5ef04ae469 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760702.610963:0:11801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045c63bcc/0x3e099f5ef04ae469 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760702.610970:0:11801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760702.610976:0:11801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045c63bcc/0x3e099f5ef04ae469 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760702.610986:0:11801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045c63bcc/0x3e099f5ef04ae469 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760702.611006:0:11801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045c63bcc/0x3e099f5ef04ae469 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760702.611014:0:11801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045c63bcc/0x3e099f5ef04ae469 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760702.611270:0:11801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863113984:12345-192.168.203.12@tcp:4:dd.500 Request processed in 45255us (149100us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1789760702.611281:0:11801:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 112 00000100:00100000:3.0:1789760702.611289:0:11801:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 306679073951 time 306679173749 state 0x2 ref 0 00000100:00100000:2.0:1789760702.630767:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760702.630836:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863114112 00000100:00100000:3.0:1789760702.630846:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863114112 00000100:00100000:3.0:1789760702.630904:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 306679073951 time 306679173749 state 0x0 ref 1 00000100:00100000:3.0:1789760702.630917:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 306879173749 time 306679173749 state 0x1 ref 1 00010000:00010000:0.0:1789760702.671558:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760702.768011:0:6698:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 306879173749 time 306881197803 state 0x0 ref 1 00000100:00100000:3.0:1789760702.768044:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d6f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863114112:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760702.768100:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 81788928, mtime: 0x6aad94bd, atime: 0x6aad94ae, ctime: 0x6aad94bd, blocks: 0x27009 00010000:00010000:3.0:1789760702.768109:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c44af9cd/0x3e099f5ef04ae470 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760702.768124:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=306s v=(0 0) 00010000:00010000:3.0:1789760702.768129:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760702.768134:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c44af9cd/0x3e099f5ef04ae470 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760702.768148:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c44af9cd/0x3e099f5ef04ae470 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760702.894574:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 81788928 -> 82837504 00002000:00010000:0.0:1789760702.894583:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789760701 -> 1789760702 00002000:00010000:0.0:1789760702.894586:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789760701 -> 1789760702 00002000:00010000:0.0:1789760702.894588:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 159753 -> 161801 00010000:00010000:0.0:1789760702.894602:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c44af9cd/0x3e099f5ef04ae470 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760702.894709:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c44af9cd/0x3e099f5ef04ae470 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760702.894718:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c44af9cd/0x3e099f5ef04ae470 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760702.894724:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760702.894729:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c44af9cd/0x3e099f5ef04ae470 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760702.894738:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c44af9cd/0x3e099f5ef04ae470 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760702.894759:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c44af9cd/0x3e099f5ef04ae470 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760702.894767:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c44af9cd/0x3e099f5ef04ae470 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760702.894985:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d6f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+7:2348:x1876699863114112:12345-192.168.203.12@tcp:4:dd.500 Request processed in 126952us (264223us total) trans 4294967403 rc 0/0 00000100:00100000:0.0:1789760702.894996:0:6698:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 113 00000100:00100000:0.0:1789760702.895003:0:6698:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 306879173749 time 306881197803 state 0x2 ref 0 00000001:00080000:2.0:1789760702.895296:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967403 is committed 00000100:00100000:2.0:1789760702.902558:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760702.902645:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863114240 00000100:00100000:3.0:1789760702.902654:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863114240 00000100:00100000:3.0:1789760702.902707:0:11799:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 306879173749 time 306881197803 state 0x0 ref 1 00000100:00100000:3.0:1789760702.902718:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 307081197803 time 306881197803 state 0x1 ref 1 00000100:00100000:3.0:1789760702.968126:0:11800:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 307081197803 time 307081311493 state 0x0 ref 1 00000100:00100000:3.0:1789760702.968159:0:11800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d6f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863114240:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760702.968230:0:11800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 82837504, mtime: 0x6aad94be, atime: 0x6aad94ae, ctime: 0x6aad94be, blocks: 0x27809 00010000:00010000:3.0:1789760702.968239:0:11800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04ae477 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760702.968280:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=307s v=(0 0) 00010000:00010000:3.0:1789760702.968284:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760702.968291:0:11800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04ae477 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760702.968305:0:11800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04ae477 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760703.038112:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967404 is committed 00002000:00010000:3.0:1789760703.038223:0:11800:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 82837504 -> 83886080 00002000:00010000:3.0:1789760703.038228:0:11800:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 161801 -> 163849 00010000:00010000:3.0:1789760703.038243:0:11800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04ae477 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760703.038264:0:11800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04ae477 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760703.038274:0:11800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04ae477 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760703.038283:0:11800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241675400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760703.038288:0:11800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04ae477 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760703.038297:0:11800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04ae477 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760703.038337:0:11800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04ae477 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760703.038522:0:11800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04ae477 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760703.038742:0:11800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d6f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863114240:12345-192.168.203.12@tcp:4:dd.500 Request processed in 70595us (136186us total) trans 4294967404 rc 0/0 00000100:00100000:3.0:1789760703.038753:0:11800:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:3.0:1789760703.038762:0:11800:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 307081197803 time 307081311493 state 0x2 ref 0 00000100:00100000:2.0:1789760703.047992:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760703.048124:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863114368 00000100:00100000:1.0:1789760703.048134:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863114368 00000100:00100000:1.0:1789760703.048206:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 307081197803 time 307081311493 state 0x0 ref 1 00000100:00100000:1.0:1789760703.048217:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 307281311493 time 307081311493 state 0x1 ref 1 00000100:00080000:2.0:1789760703.048606:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760703.092861:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760703.092926:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760703.092949:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760703.093065:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863114624 00000100:00100000:3.0:1789760703.093077:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863114624 00000100:00100000:3.0:1789760703.093141:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:3.0:1789760703.093151:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+8:2349:x1876699863114624:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760703.093231:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+8:2349:x1876699863114624:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 81us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760703.093238:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00080000:3.0:1789760703.093274:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760703.093551:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863114752 00000100:00100000:1.0:1789760703.093556:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863114752 00000100:00100000:1.0:1789760703.093600:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:1.0:1789760703.093609:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863114752:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1789760703.093649:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863114752:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 42us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760703.093655:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:0.0:1789760703.094102:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760703.094566:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863114880 00000100:00100000:1.0:1789760703.094571:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863114880 00000100:00100000:1.0:1789760703.094626:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:1.0:1789760703.094634:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2349:x1876699863114880:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1789760703.094682:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2349:x1876699863114880:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 48us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760703.094688:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:2.0:1789760703.094733:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863114496 00000100:00100000:2.0:1789760703.094738:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863114496 00000100:00100000:2.0:1789760703.094776:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 259 00000100:00100000:2.0:1789760703.094783:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2349:x1876699863114496:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1789760703.094834:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2349:x1876699863114496:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 52us (1984us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760703.094840:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 259 00000100:00080000:3.0:1789760703.095099:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789760703.095104:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789760703.175905:0:11801:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 307281311493 time 307289088490 state 0x0 ref 1 00000100:00100000:3.0:1789760703.175945:0:11801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d6f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863114368:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760703.176016:0:11801:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 83886080, mtime: 0x6aad94be, atime: 0x6aad94ae, ctime: 0x6aad94be, blocks: 0x28009 00010000:00010000:3.0:1789760703.176037:0:11801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04ae47e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760703.176168:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=307s v=(0 0) 00010000:00010000:3.0:1789760703.176173:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760703.176180:0:11801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04ae47e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760703.176195:0:11801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04ae47e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760703.316588:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967405 is committed 00002000:00010000:1.0:1789760703.316742:0:11801:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 83886080 -> 84934656 00002000:00010000:1.0:1789760703.316747:0:11801:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 163849 -> 165897 00010000:00010000:1.0:1789760703.316775:0:11801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04ae47e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760703.316787:0:11801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04ae47e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760703.316796:0:11801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04ae47e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760703.316916:0:11801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241675400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760703.316921:0:11801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04ae47e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760703.316931:0:11801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04ae47e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760703.316952:0:11801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04ae47e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760703.316960:0:11801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04ae47e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760703.317150:0:11801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d6f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863114368:12345-192.168.203.12@tcp:4:dd.500 Request processed in 141222us (269163us total) trans 4294967405 rc 0/0 00000100:00100000:1.0:1789760703.317161:0:11801:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:1.0:1789760703.317169:0:11801:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 307281311493 time 307289088490 state 0x2 ref 0 00000100:00100000:0.0:1789760703.324609:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760703.324778:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863115008 00000100:00100000:3.0:1789760703.324787:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863115008 00000100:00100000:3.0:1789760703.324969:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 307281311493 time 307289088490 state 0x0 ref 1 00000100:00100000:3.0:1789760703.324981:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 307489088490 time 307289088490 state 0x1 ref 1 00000100:00100000:0.0:1789760703.376328:0:6698:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 307489088490 time 307489513741 state 0x0 ref 1 00000100:00100000:0.0:1789760703.376363:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863115008:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760703.376436:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 84934656, mtime: 0x6aad94be, atime: 0x6aad94ae, ctime: 0x6aad94be, blocks: 0x28809 00010000:00010000:0.0:1789760703.376445:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045c63bcc/0x3e099f5ef04ae485 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760703.376462:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=307s v=(0 0) 00010000:00010000:0.0:1789760703.376466:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760703.376473:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045c63bcc/0x3e099f5ef04ae485 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760703.376487:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045c63bcc/0x3e099f5ef04ae485 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760703.450947:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967406 is committed 00002000:00010000:0.0:1789760703.451183:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 84934656 -> 85983232 00002000:00010000:0.0:1789760703.451188:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 165897 -> 167945 00010000:00010000:0.0:1789760703.451204:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045c63bcc/0x3e099f5ef04ae485 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760703.451216:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045c63bcc/0x3e099f5ef04ae485 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760703.451246:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045c63bcc/0x3e099f5ef04ae485 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760703.451325:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760703.451331:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045c63bcc/0x3e099f5ef04ae485 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760703.451341:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045c63bcc/0x3e099f5ef04ae485 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760703.451362:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045c63bcc/0x3e099f5ef04ae485 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760703.451371:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045c63bcc/0x3e099f5ef04ae485 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760703.453188:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863115008:12345-192.168.203.12@tcp:4:dd.500 Request processed in 76831us (128577us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1789760703.453201:0:6698:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 116 00000100:00100000:0.0:1789760703.453209:0:6698:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 307489088490 time 307489513741 state 0x2 ref 0 00000100:00100000:1.0:1789760703.475071:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760703.475159:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863115136 00000100:00100000:3.0:1789760703.475168:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863115136 00000100:00100000:3.0:1789760703.475225:0:11799:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 307489088490 time 307489513741 state 0x0 ref 1 00000100:00100000:3.0:1789760703.475238:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 307689513741 time 307489513741 state 0x1 ref 1 00000100:00100000:3.0:1789760703.576444:0:11800:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 307689513741 time 307689628459 state 0x0 ref 1 00000100:00100000:3.0:1789760703.576481:0:11800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863115136:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760703.576541:0:11800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 85983232, mtime: 0x6aad94be, atime: 0x6aad94ae, ctime: 0x6aad94be, blocks: 0x29009 00010000:00010000:3.0:1789760703.576567:0:11800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae48c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760703.576583:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=307s v=(0 0) 00010000:00010000:3.0:1789760703.576588:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760703.576594:0:11800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae48c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760703.576619:0:11800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae48c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760703.674599:0:11800:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 85983232 -> 87031808 00002000:00010000:3.0:1789760703.674617:0:11800:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 167945 -> 169993 00010000:00010000:3.0:1789760703.674632:0:11800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae48c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760703.674645:0:11800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae48c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760703.674654:0:11800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae48c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760703.674662:0:11800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760703.674667:0:11800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae48c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760703.674864:0:11800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae48c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760703.674906:0:11800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae48c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760703.674914:0:11800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae48c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760703.675029:0:11800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+7:2349:x1876699863115136:12345-192.168.203.12@tcp:4:dd.500 Request processed in 98562us (199962us total) trans 4294967407 rc 0/0 00000100:00100000:3.0:1789760703.675040:0:11800:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 117 00000100:00100000:3.0:1789760703.675048:0:11800:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 307689513741 time 307689628459 state 0x2 ref 0 00000100:00100000:1.0:1789760703.685529:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760703.686365:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863115264 00000100:00100000:3.0:1789760703.686377:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863115264 00000100:00100000:3.0:1789760703.686445:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 307689513741 time 307689628459 state 0x0 ref 1 00000100:00100000:3.0:1789760703.686467:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 307889628459 time 307689628459 state 0x1 ref 1 00000001:00080000:2.0:1789760703.687138:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967407 is committed 00010000:00010000:0.0:1789760703.695741:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760703.777482:0:11801:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 307889628459 time 307890667358 state 0x0 ref 1 00000100:00100000:1.0:1789760703.777516:0:11801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863115264:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760703.777577:0:11801:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 87031808, mtime: 0x6aad94be, atime: 0x6aad94ae, ctime: 0x6aad94be, blocks: 0x29809 00010000:00010000:1.0:1789760703.777586:0:11801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e88fa1c/0x3e099f5ef04ae493 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760703.777601:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=307s v=(0 0) 00010000:00010000:1.0:1789760703.777605:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760703.777622:0:11801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e88fa1c/0x3e099f5ef04ae493 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760703.777636:0:11801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e88fa1c/0x3e099f5ef04ae493 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760703.853039:0:11801:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 87031808 -> 88080384 00002000:00010000:0.0:1789760703.853048:0:11801:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789760702 -> 1789760703 00002000:00010000:0.0:1789760703.853051:0:11801:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789760702 -> 1789760703 00002000:00010000:0.0:1789760703.853067:0:11801:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 169993 -> 172041 00010000:00010000:0.0:1789760703.853083:0:11801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e88fa1c/0x3e099f5ef04ae493 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760703.853096:0:11801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e88fa1c/0x3e099f5ef04ae493 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760703.853106:0:11801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e88fa1c/0x3e099f5ef04ae493 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760703.853112:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967408 is committed 00010000:00010000:0.0:1789760703.853114:0:11801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f077800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760703.853121:0:11801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e88fa1c/0x3e099f5ef04ae493 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760703.853131:0:11801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e88fa1c/0x3e099f5ef04ae493 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760703.853151:0:11801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e88fa1c/0x3e099f5ef04ae493 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760703.853159:0:11801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e88fa1c/0x3e099f5ef04ae493 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760703.853259:0:11801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863115264:12345-192.168.203.12@tcp:4:dd.500 Request processed in 75755us (167737us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1789760703.853269:0:11801:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:0.0:1789760703.853277:0:11801:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 307889628459 time 307890667358 state 0x2 ref 0 00000100:00100000:1.0:1789760703.859767:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760703.859961:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863115392 00000100:00100000:3.0:1789760703.859970:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863115392 00000100:00100000:3.0:1789760703.860026:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 307889628459 time 307890667358 state 0x0 ref 1 00000100:00100000:3.0:1789760703.860039:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 308090667358 time 307890667358 state 0x1 ref 1 00000100:00100000:0.0:1789760703.977719:0:6698:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 308090667358 time 308090904727 state 0x0 ref 1 00000100:00100000:0.0:1789760703.977751:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863115392:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760703.977914:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 88080384, mtime: 0x6aad94bf, atime: 0x6aad94ae, ctime: 0x6aad94bf, blocks: 0x2a009 00010000:00010000:0.0:1789760703.977936:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae49a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760703.977954:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=308s v=(0 0) 00010000:00010000:0.0:1789760703.977958:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760703.977963:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae49a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760703.977978:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae49a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760704.079677:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14347d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883042560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789760704.079740:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760704.079922:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883042560 00000100:00100000:3.0:1789760704.079930:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883042560 00000100:00100000:3.0:1789760704.080000:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789760704.080011:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883042560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760704.080033:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 1703936 free 3776970752 avail 3769630720 00000100:00100000:3.0:1789760704.080091:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883042560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760704.080098:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1789760704.080199:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760704.080235:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14347d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883042560:0@lo:13:osp-pre-0-0.0 00002000:00010000:3.0:1789760704.105217:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 88080384 -> 89128960 00002000:00010000:3.0:1789760704.105227:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 172041 -> 174089 00010000:00010000:3.0:1789760704.105240:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae49a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760704.105252:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae49a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760704.105261:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae49a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760704.105269:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760704.105273:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae49a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760704.105282:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae49a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760704.105302:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae49a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760704.105310:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae49a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760704.105440:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+7:2349:x1876699863115392:12345-192.168.203.12@tcp:4:dd.500 Request processed in 127699us (245677us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1789760704.105451:0:6698:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:3.0:1789760704.105460:0:6698:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 308090667358 time 308090904727 state 0x2 ref 0 00000001:00080000:0.0:1789760704.107249:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967409 is committed 00000100:00100000:2.0:1789760704.112628:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760704.112942:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863115520 00000100:00100000:3.0:1789760704.112953:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863115520 00000100:00100000:3.0:1789760704.113017:0:11799:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 308090667358 time 308090904727 state 0x0 ref 1 00000100:00100000:3.0:1789760704.113030:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 308290904727 time 308090904727 state 0x1 ref 1 00000100:00100000:3.0:1789760704.178378:0:11800:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 308290904727 time 308291562530 state 0x0 ref 1 00000100:00100000:3.0:1789760704.178414:0:11800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d6f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863115520:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760704.178476:0:11800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 89128960, mtime: 0x6aad94bf, atime: 0x6aad94ae, ctime: 0x6aad94bf, blocks: 0x2a809 00010000:00010000:3.0:1789760704.178485:0:11800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760704.178501:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=308s v=(0 0) 00010000:00010000:3.0:1789760704.178505:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760704.178512:0:11800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760704.178527:0:11800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760704.262527:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967410 is committed 00002000:00010000:3.0:1789760704.262690:0:11800:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 89128960 -> 90177536 00002000:00010000:3.0:1789760704.262694:0:11800:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 174089 -> 176137 00010000:00010000:3.0:1789760704.262708:0:11800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760704.262719:0:11800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760704.262727:0:11800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760704.262734:0:11800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760704.262738:0:11800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760704.262746:0:11800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760704.262764:0:11800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4a1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760704.262771:0:11800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760704.263090:0:11800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d6f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863115520:12345-192.168.203.12@tcp:4:dd.500 Request processed in 84688us (150467us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1789760704.263114:0:11800:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:3.0:1789760704.263123:0:11800:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 308290904727 time 308291562530 state 0x2 ref 0 00000100:00100000:0.0:1789760704.271103:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760704.271254:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863115648 00000100:00100000:3.0:1789760704.271264:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863115648 00000100:00100000:3.0:1789760704.271319:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 308290904727 time 308291562530 state 0x0 ref 1 00000100:00100000:3.0:1789760704.271396:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 308491562530 time 308291562530 state 0x1 ref 1 00000100:00100000:0.0:1789760704.378522:0:11801:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 308491562530 time 308491707263 state 0x0 ref 1 00000100:00100000:0.0:1789760704.378558:0:11801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df274bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863115648:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760704.378653:0:11801:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 90177536, mtime: 0x6aad94bf, atime: 0x6aad94ae, ctime: 0x6aad94bf, blocks: 0x2b009 00010000:00010000:0.0:1789760704.378662:0:11801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae4a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760704.378678:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=308s v=(0 0) 00010000:00010000:0.0:1789760704.378683:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760704.378690:0:11801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae4a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760704.378706:0:11801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae4a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760704.561061:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967411 is committed 00002000:00010000:2.0:1789760704.561172:0:11801:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 90177536 -> 91226112 00002000:00010000:2.0:1789760704.561178:0:11801:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 176137 -> 178185 00010000:00010000:2.0:1789760704.561194:0:11801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae4a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760704.561207:0:11801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae4a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760704.561216:0:11801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae4a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760704.561223:0:11801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760704.561244:0:11801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae4a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760704.561253:0:11801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae4a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760704.561274:0:11801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae4a8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760704.561282:0:11801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04ae4a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760704.561624:0:11801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df274bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863115648:12345-192.168.203.12@tcp:4:dd.500 Request processed in 183077us (290521us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1789760704.561634:0:11801:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:2.0:1789760704.561643:0:11801:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 308491562530 time 308491707263 state 0x2 ref 0 00000100:00100000:2.0:1789760704.577886:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760704.578096:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863115776 00000100:00100000:3.0:1789760704.578106:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863115776 00000100:00100000:3.0:1789760704.578165:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 308491562530 time 308491707263 state 0x0 ref 1 00000100:00100000:3.0:1789760704.578179:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 308691707263 time 308491707263 state 0x1 ref 1 00000100:00100000:3.0:1789760704.578771:0:6698:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 308691707263 time 308691964526 state 0x0 ref 1 00000100:00100000:3.0:1789760704.578789:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863115776:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760704.579014:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 91226112, mtime: 0x6aad94bf, atime: 0x6aad94ae, ctime: 0x6aad94bf, blocks: 0x2b809 00010000:00010000:3.0:1789760704.579025:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760704.579053:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=308s v=(0 0) 00010000:00010000:3.0:1789760704.579058:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760704.579180:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760704.579198:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760704.664577:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967412 is committed 00002000:00010000:3.0:1789760704.664712:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 91226112 -> 92274688 00002000:00010000:3.0:1789760704.664717:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 178185 -> 180233 00010000:00010000:3.0:1789760704.664731:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760704.664745:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760704.664754:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760704.664761:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760704.664766:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760704.664775:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760704.664793:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4af lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760704.664907:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760704.665002:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863115776:12345-192.168.203.12@tcp:4:dd.500 Request processed in 86214us (87121us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1789760704.665028:0:6698:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:3.0:1789760704.665036:0:6698:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 308691707263 time 308691964526 state 0x2 ref 0 00000100:00100000:0.0:1789760704.680671:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760704.685340:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863115904 00000100:00100000:3.0:1789760704.685354:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863115904 00000100:00100000:2.0:1789760704.685656:0:11799:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 308691707263 time 308691964526 state 0x0 ref 1 00000100:00100000:2.0:1789760704.685670:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 308891964526 time 308691964526 state 0x1 ref 1 00010000:00010000:3.0:1789760704.719126:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760704.779155:0:11800:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 308891964526 time 308892340795 state 0x0 ref 1 00000100:00100000:3.0:1789760704.779189:0:11800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df274bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863115904:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760704.779248:0:11800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 92274688, mtime: 0x6aad94bf, atime: 0x6aad94ae, ctime: 0x6aad94bf, blocks: 0x2c009 00010000:00010000:3.0:1789760704.779256:0:11800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760704.779273:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=308s v=(0 0) 00010000:00010000:3.0:1789760704.779277:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760704.779284:0:11800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760704.779299:0:11800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760704.841350:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967413 is committed 00002000:00010000:3.0:1789760704.843726:0:11800:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 92274688 -> 93323264 00002000:00010000:3.0:1789760704.843731:0:11800:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789760703 -> 1789760704 00002000:00010000:3.0:1789760704.843733:0:11800:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789760703 -> 1789760704 00002000:00010000:3.0:1789760704.843736:0:11800:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 180233 -> 182281 00010000:00010000:3.0:1789760704.843750:0:11800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760704.843778:0:11800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760704.843787:0:11800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760704.843795:0:11800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760704.843799:0:11800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760704.843836:0:11800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4b6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760704.843856:0:11800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4b6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760704.843864:0:11800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760704.843974:0:11800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df274bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863115904:12345-192.168.203.12@tcp:4:dd.500 Request processed in 64797us (163376us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1789760704.843983:0:11800:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:3.0:1789760704.843990:0:11800:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 308891964526 time 308892340795 state 0x2 ref 0 00000100:00100000:2.0:1789760704.853158:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760704.853266:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863116032 00000100:00100000:1.0:1789760704.853276:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863116032 00000100:00100000:1.0:1789760704.853340:0:6699:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 308891964526 time 308892340795 state 0x0 ref 1 00000100:00100000:1.0:1789760704.853353:0:6699:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 309092340795 time 308892340795 state 0x1 ref 1 00000100:00100000:2.0:1789760704.981721:0:11801:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 309092340795 time 309094906002 state 0x0 ref 1 00000100:00100000:2.0:1789760704.981757:0:11801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d28ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863116032:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760704.981850:0:11801:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 93323264, mtime: 0x6aad94c0, atime: 0x6aad94ae, ctime: 0x6aad94c0, blocks: 0x2c809 00010000:00010000:2.0:1789760704.981859:0:11801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007558f5bb/0x3e099f5ef04ae4bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760704.981878:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=309s v=(0 0) 00010000:00010000:2.0:1789760704.981883:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760704.981889:0:11801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007558f5bb/0x3e099f5ef04ae4bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760704.981905:0:11801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007558f5bb/0x3e099f5ef04ae4bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760705.020841:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967414 is committed 00002000:00010000:2.0:1789760705.021123:0:11801:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 93323264 -> 94371840 00002000:00010000:2.0:1789760705.021128:0:11801:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 182281 -> 184331 00010000:00010000:2.0:1789760705.021142:0:11801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007558f5bb/0x3e099f5ef04ae4bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760705.021155:0:11801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007558f5bb/0x3e099f5ef04ae4bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760705.021163:0:11801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007558f5bb/0x3e099f5ef04ae4bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760705.021170:0:11801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b8e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760705.021174:0:11801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007558f5bb/0x3e099f5ef04ae4bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760705.021194:0:11801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007558f5bb/0x3e099f5ef04ae4bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760705.021215:0:11801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007558f5bb/0x3e099f5ef04ae4bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760705.021224:0:11801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007558f5bb/0x3e099f5ef04ae4bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760705.021364:0:11801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d28ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863116032:12345-192.168.203.12@tcp:4:dd.500 Request processed in 39619us (168210us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1789760705.021378:0:11801:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:2.0:1789760705.021386:0:11801:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 309092340795 time 309094906002 state 0x2 ref 0 00000100:00100000:2.0:1789760705.027128:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760705.027259:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863116160 00000100:00100000:3.0:1789760705.027276:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863116160 00000100:00100000:3.0:1789760705.027356:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 309092340795 time 309094906002 state 0x0 ref 1 00000100:00100000:3.0:1789760705.027370:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 309294906002 time 309094906002 state 0x1 ref 1 00000100:00080000:0.0:1789760705.027572:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760705.183226:0:6698:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 309294906002 time 309296411324 state 0x0 ref 1 00000100:00100000:3.0:1789760705.183262:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d28c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863116160:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760705.183325:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 94371840, mtime: 0x6aad94c0, atime: 0x6aad94ae, ctime: 0x6aad94c0, blocks: 0x2d00b 00010000:00010000:3.0:1789760705.183334:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760705.183350:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=309s v=(0 0) 00010000:00010000:3.0:1789760705.183354:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760705.183420:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760705.183437:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760705.246402:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967415 is committed 00002000:00010000:2.0:1789760705.246631:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 94371840 -> 95420416 00002000:00010000:2.0:1789760705.246636:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 184331 -> 186379 00010000:00010000:2.0:1789760705.246650:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760705.246662:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760705.246670:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760705.246699:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760705.246704:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760705.246712:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760705.246732:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760705.246739:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760705.246882:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d28c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863116160:12345-192.168.203.12@tcp:4:dd.500 Request processed in 63633us (219759us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1789760705.246893:0:6698:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:2.0:1789760705.246902:0:6698:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 309294906002 time 309296411324 state 0x2 ref 0 00000100:00100000:2.0:1789760705.258435:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760705.258498:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863116288 00000100:00100000:3.0:1789760705.258508:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863116288 00000100:00100000:3.0:1789760705.258564:0:11799:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 309294906002 time 309296411324 state 0x0 ref 1 00000100:00100000:3.0:1789760705.258576:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 309496411324 time 309296411324 state 0x1 ref 1 00000100:00100000:3.0:1789760705.383346:0:11800:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 309496411324 time 309496528210 state 0x0 ref 1 00000100:00100000:3.0:1789760705.383380:0:11800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d28f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863116288:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760705.383454:0:11800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 95420416, mtime: 0x6aad94c0, atime: 0x6aad94ae, ctime: 0x6aad94c0, blocks: 0x2d80b 00010000:00010000:3.0:1789760705.383464:0:11800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760705.383480:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=309s v=(0 0) 00010000:00010000:3.0:1789760705.383485:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760705.383492:0:11800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760705.383506:0:11800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760705.435418:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967416 is committed 00002000:00010000:0.0:1789760705.435556:0:11800:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 95420416 -> 96468992 00002000:00010000:0.0:1789760705.435560:0:11800:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 186379 -> 188427 00010000:00010000:0.0:1789760705.435571:0:11800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760705.435583:0:11800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760705.435589:0:11800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760705.435624:0:11800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760705.435630:0:11800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760705.435639:0:11800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760705.435659:0:11800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4cb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760705.435667:0:11800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04ae4cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760705.435776:0:11800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d28f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863116288:12345-192.168.203.12@tcp:4:dd.500 Request processed in 52403us (177340us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1789760705.435787:0:11800:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:0.0:1789760705.435795:0:11800:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 309496411324 time 309496528210 state 0x2 ref 0 00000100:00100000:2.0:1789760705.442462:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760705.442544:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863116416 00000100:00100000:1.0:1789760705.442555:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863116416 00000100:00100000:1.0:1789760705.442636:0:6699:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 309496411324 time 309496528210 state 0x0 ref 1 00000100:00100000:1.0:1789760705.442653:0:6699:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 309696528210 time 309496528210 state 0x1 ref 1 00000100:00100000:2.0:1789760705.584840:0:11801:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 309696528210 time 309698025426 state 0x0 ref 1 00000100:00100000:2.0:1789760705.584874:0:11801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863116416:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760705.584944:0:11801:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 96468992, mtime: 0x6aad94c0, atime: 0x6aad94ae, ctime: 0x6aad94c0, blocks: 0x2e00b 00010000:00010000:2.0:1789760705.584953:0:11801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fac42dd/0x3e099f5ef04ae4d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760705.584982:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=309s v=(0 0) 00010000:00010000:2.0:1789760705.584987:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760705.584994:0:11801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fac42dd/0x3e099f5ef04ae4d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760705.585008:0:11801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fac42dd/0x3e099f5ef04ae4d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760705.615099:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789760705.615122:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d28e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699883042688:0@lo:400:kworker.0 00000100:00100000:0.0:1789760705.615187:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760705.615264:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d28f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1876699883043200:0@lo:400:kworker.0 00000100:00100000:1.0:1789760705.615298:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760705.615390:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883043200 00000100:00100000:3.0:1789760705.615398:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883043200 00000100:00100000:2.0:1789760705.615433:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883042688 00000100:00100000:2.0:1789760705.615437:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883042688 00000100:00100000:2.0:1789760705.615490:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789760705.615501:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+19:3308:x1876699883042688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760705.615578:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789760705.615585:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876699883043200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760705.615668:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789760705.615675:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d28c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883043072:0@lo:400:kworker.0 00000100:00100000:0.0:1789760705.615751:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d28d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876699883042816:0@lo:400:kworker.0 00000100:00100000:0.0:1789760705.615779:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760705.615797:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d28fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883043328:0@lo:400:kworker.0 00000100:00100000:0.0:1789760705.615852:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760705.615863:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+19:3308:x1876699883042688:12345-0@lo:400:kworker.0 Request processed in 364us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760705.615871:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789760705.615879:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789760705.615884:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d28ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1876699883042944:0@lo:400:kworker.0 00000100:00100000:0.0:1789760705.615905:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760705.615925:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d28e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699883042688:0@lo:400:kworker.0 00000100:00080000:0.0:1789760705.615928:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760705.615951:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883042816 00000100:00100000:0.0:1789760705.615955:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883042816 00000100:00100000:0.0:1789760705.615973:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883042944 00000100:00100000:0.0:1789760705.615975:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883042944 00000100:00100000:0.0:1789760705.616166:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789760705.616172:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df274bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876699883042816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760705.616186:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876699883043200:12345-0@lo:400:kworker.0 Request processed in 602us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760705.616193:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789760705.616205:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df274bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876699883042816:12345-0@lo:400:kworker.0 Request processed in 34us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760705.616207:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789760705.616211:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789760705.616212:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df274bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876699883042944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760705.616238:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d28d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876699883042816:0@lo:400:kworker.0 00000100:00100000:3.0:1789760705.616239:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df274bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876699883042944:12345-0@lo:400:kworker.0 Request processed in 26us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760705.616244:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789760705.616320:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760705.616353:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d28f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1876699883043200:0@lo:400:kworker.0 00000100:00100000:0.0:1789760705.616364:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d28ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1876699883042944:0@lo:400:kworker.0 00000100:00100000:1.0:1789760705.616383:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883043328 00000100:00100000:1.0:1789760705.616387:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883043328 00000100:00100000:3.0:1789760705.616428:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883043072 00000100:00100000:3.0:1789760705.616432:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883043072 00000100:00100000:3.0:1789760705.616474:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789760705.616482:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883043072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760705.616518:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883043072:12345-0@lo:400:kworker.0 Request processed in 38us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760705.616524:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789760705.616536:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d28c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883043072:0@lo:400:kworker.0 00000100:00080000:2.0:1789760705.616602:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789760705.616606:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760705.616692:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789760705.616698:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df274bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883043328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760705.616731:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df274bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883043328:12345-0@lo:400:kworker.0 Request processed in 34us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760705.616738:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789760705.616763:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d28fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883043328:0@lo:400:kworker.0 00002000:00010000:3.0:1789760705.626199:0:11801:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 96468992 -> 97517568 00002000:00010000:3.0:1789760705.626208:0:11801:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 188427 -> 190475 00010000:00010000:3.0:1789760705.626223:0:11801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fac42dd/0x3e099f5ef04ae4d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760705.626238:0:11801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fac42dd/0x3e099f5ef04ae4d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760705.626247:0:11801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fac42dd/0x3e099f5ef04ae4d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760705.626254:0:11801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b8a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760705.626258:0:11801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fac42dd/0x3e099f5ef04ae4d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760705.626268:0:11801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fac42dd/0x3e099f5ef04ae4d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760705.626287:0:11801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fac42dd/0x3e099f5ef04ae4d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760705.626295:0:11801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fac42dd/0x3e099f5ef04ae4d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760705.626413:0:11801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+7:2350:x1876699863116416:12345-192.168.203.12@tcp:4:dd.500 Request processed in 41551us (183956us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1789760705.626424:0:11801:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 127 00000100:00100000:3.0:1789760705.626432:0:11801:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 309696528210 time 309698025426 state 0x2 ref 0 00000001:00080000:0.0:1789760705.627198:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967417 is committed 00000100:00100000:0.0:1789760705.635551:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760705.635721:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863116544 00000100:00100000:2.0:1789760705.635734:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863116544 00000100:00100000:2.0:1789760705.635795:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 309696528210 time 309698025426 state 0x0 ref 1 00000100:00100000:2.0:1789760705.635851:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 309898025426 time 309698025426 state 0x1 ref 1 00010000:00010000:0.0:1789760705.744399:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760705.785427:0:6698:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 309898025426 time 309898611980 state 0x0 ref 1 00000100:00100000:2.0:1789760705.785461:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df274bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863116544:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760705.786465:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 97517568, mtime: 0x6aad94c0, atime: 0x6aad94ae, ctime: 0x6aad94c0, blocks: 0x2e80b 00010000:00010000:2.0:1789760705.786478:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb76d6dc/0x3e099f5ef04ae4d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760705.786496:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=309s v=(0 0) 00010000:00010000:2.0:1789760705.786501:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760705.786508:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb76d6dc/0x3e099f5ef04ae4d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760705.786522:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb76d6dc/0x3e099f5ef04ae4d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760705.873206:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 97517568 -> 98566144 00002000:00010000:0.0:1789760705.873214:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789760704 -> 1789760705 00002000:00010000:0.0:1789760705.873217:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789760704 -> 1789760705 00002000:00010000:0.0:1789760705.873219:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 190475 -> 192523 00010000:00010000:0.0:1789760705.873234:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb76d6dc/0x3e099f5ef04ae4d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760705.873267:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb76d6dc/0x3e099f5ef04ae4d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760705.873277:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb76d6dc/0x3e099f5ef04ae4d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760705.873285:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b9c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760705.873289:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb76d6dc/0x3e099f5ef04ae4d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760705.873298:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb76d6dc/0x3e099f5ef04ae4d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760705.873317:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb76d6dc/0x3e099f5ef04ae4d9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760705.873325:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb76d6dc/0x3e099f5ef04ae4d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760705.873514:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967418 is committed 00000100:00100000:0.0:1789760705.873638:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df274bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863116544:12345-192.168.203.12@tcp:4:dd.500 Request processed in 88188us (238091us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1789760705.873649:0:6698:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 128 00000100:00100000:0.0:1789760705.873657:0:6698:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 309898025426 time 309898611980 state 0x2 ref 0 00000100:00100000:1.0:1789760705.884213:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760705.884410:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863116672 00000100:00100000:2.0:1789760705.884422:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863116672 00000100:00100000:2.0:1789760705.884476:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 309898025426 time 309898611980 state 0x0 ref 1 00000100:00100000:2.0:1789760705.884489:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 310098611980 time 309898611980 state 0x1 ref 1 00000100:00100000:0.0:1789760705.985873:0:11800:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 310098611980 time 310099058982 state 0x0 ref 1 00000100:00100000:0.0:1789760705.985923:0:11800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863116672:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760705.985979:0:11800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 98566144, mtime: 0x6aad94c1, atime: 0x6aad94ae, ctime: 0x6aad94c1, blocks: 0x2f00b 00010000:00010000:0.0:1789760705.985988:0:11800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760705.986003:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=310s v=(0 0) 00010000:00010000:0.0:1789760705.986007:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760705.986013:0:11800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760705.986030:0:11800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760706.030897:0:11800:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 98566144 -> 99614720 00002000:00010000:0.0:1789760706.030908:0:11800:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 192523 -> 194571 00010000:00010000:0.0:1789760706.030934:0:11800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.030947:0:11800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.030957:0:11800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.030965:0:11800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760706.030971:0:11800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.030992:0:11800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.031012:0:11800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.031020:0:11800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760706.031109:0:11800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+7:2351:x1876699863116672:12345-192.168.203.12@tcp:4:dd.500 Request processed in 45195us (146902us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1789760706.031120:0:11800:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 129 00000100:00100000:0.0:1789760706.031128:0:11800:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 310098611980 time 310099058982 state 0x2 ref 0 00000001:00080000:3.0:1789760706.031481:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967419 is committed 00000100:00100000:1.0:1789760706.045760:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760706.046673:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863116800 00000100:00100000:3.0:1789760706.046685:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863116800 00000100:00100000:3.0:1789760706.046743:0:6699:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 310098611980 time 310099058982 state 0x0 ref 1 00000100:00100000:3.0:1789760706.046758:0:6699:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 310299058982 time 310099058982 state 0x1 ref 1 00000100:00100000:1.0:1789760706.127741:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14347ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883043456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760706.127846:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760706.129157:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883043456 00000100:00100000:3.0:1789760706.129168:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883043456 00000100:00100000:3.0:1789760706.129233:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789760706.129245:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883043456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789760706.129288:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 71499776 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760706.129361:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883043456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760706.129370:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789760706.129398:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14347ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883043456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760706.185990:0:11801:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 310299058982 time 310299176742 state 0x0 ref 1 00000100:00100000:3.0:1789760706.186116:0:11801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863116800:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760706.186178:0:11801:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 99614720, mtime: 0x6aad94c1, atime: 0x6aad94ae, ctime: 0x6aad94c1, blocks: 0x2f80b 00010000:00010000:3.0:1789760706.186189:0:11801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04ae4e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760706.186215:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=310s v=(0 0) 00010000:00010000:3.0:1789760706.186218:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760706.186223:0:11801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04ae4e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760706.186234:0:11801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04ae4e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760706.242395:0:11801:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 99614720 -> 100663296 00002000:00010000:0.0:1789760706.242406:0:11801:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 194571 -> 196619 00010000:00010000:0.0:1789760706.242421:0:11801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04ae4e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.242434:0:11801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04ae4e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.242442:0:11801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04ae4e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.242449:0:11801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241675400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760706.242468:0:11801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04ae4e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.242478:0:11801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04ae4e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.242498:0:11801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04ae4e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.242505:0:11801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04ae4e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760706.242623:0:11801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+7:2351:x1876699863116800:12345-192.168.203.12@tcp:4:dd.500 Request processed in 56611us (196868us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1789760706.242634:0:11801:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 130 00000100:00100000:0.0:1789760706.242642:0:11801:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 310299058982 time 310299176742 state 0x2 ref 0 00000001:00080000:3.0:1789760706.243283:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967420 is committed 00000100:00100000:1.0:1789760706.249991:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760706.250170:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863116928 00000100:00100000:2.0:1789760706.250181:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863116928 00000100:00100000:2.0:1789760706.250231:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 310299058982 time 310299176742 state 0x0 ref 1 00000100:00100000:2.0:1789760706.250243:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 310499176742 time 310299176742 state 0x1 ref 1 00000100:00100000:0.0:1789760706.386445:0:6698:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 310499176742 time 310499630674 state 0x0 ref 1 00000100:00100000:0.0:1789760706.386477:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863116928:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760706.386530:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 100663296, mtime: 0x6aad94c1, atime: 0x6aad94ae, ctime: 0x6aad94c1, blocks: 0x3000b 00010000:00010000:0.0:1789760706.386538:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.386553:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=310s v=(0 0) 00010000:00010000:0.0:1789760706.386558:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760706.386563:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.386607:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760706.440955:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 100663296 -> 101711872 00002000:00010000:0.0:1789760706.440964:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 196619 -> 198667 00010000:00010000:0.0:1789760706.440977:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.440990:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.441000:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.441008:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760706.441012:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.441138:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.441160:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4ee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.441167:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760706.441269:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+7:2350:x1876699863116928:12345-192.168.203.12@tcp:4:dd.500 Request processed in 54802us (191282us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1789760706.441279:0:6698:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 131 00000100:00100000:0.0:1789760706.441286:0:6698:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 310499176742 time 310499630674 state 0x2 ref 0 00000001:00080000:1.0:1789760706.441355:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967421 is committed 00000100:00100000:1.0:1789760706.448226:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760706.448461:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863117056 00000100:00100000:2.0:1789760706.448470:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863117056 00000100:00100000:2.0:1789760706.448518:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 310499176742 time 310499630674 state 0x0 ref 1 00000100:00100000:2.0:1789760706.448529:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 310699630674 time 310499630674 state 0x1 ref 1 00000100:00100000:0.0:1789760706.586727:0:11800:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 310699630674 time 310699912573 state 0x0 ref 1 00000100:00100000:0.0:1789760706.586758:0:11800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863117056:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760706.586903:0:11800:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 101711872, mtime: 0x6aad94c1, atime: 0x6aad94ae, ctime: 0x6aad94c1, blocks: 0x3080b 00010000:00010000:0.0:1789760706.586913:0:11800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.586929:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=310s v=(0 0) 00010000:00010000:0.0:1789760706.586933:0:11800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760706.586939:0:11800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.586953:0:11800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760706.636313:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967422 is committed 00002000:00010000:0.0:1789760706.636472:0:11800:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 101711872 -> 102760448 00002000:00010000:0.0:1789760706.636478:0:11800:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 198667 -> 200715 00010000:00010000:0.0:1789760706.636490:0:11800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.636521:0:11800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.636541:0:11800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.636550:0:11800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760706.636554:0:11800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.636563:0:11800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.636582:0:11800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4f5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.636598:0:11800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760706.636688:0:11800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863117056:12345-192.168.203.12@tcp:4:dd.500 Request processed in 49940us (188467us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1789760706.636697:0:11800:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 132 00000100:00100000:0.0:1789760706.636704:0:11800:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 310699630674 time 310699912573 state 0x2 ref 0 00000100:00100000:1.0:1789760706.645549:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760706.645687:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863117184 00000100:00100000:3.0:1789760706.645697:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863117184 00000100:00100000:3.0:1789760706.645747:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 310699630674 time 310699912573 state 0x0 ref 1 00000100:00100000:3.0:1789760706.645760:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 310899912573 time 310699912573 state 0x1 ref 1 00010000:00010000:0.0:1789760706.767082:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760706.786943:0:11801:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 310899912573 time 310900128281 state 0x0 ref 1 00000100:00100000:0.0:1789760706.786975:0:11801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863117184:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760706.787035:0:11801:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 102760448, mtime: 0x6aad94c1, atime: 0x6aad94ae, ctime: 0x6aad94c1, blocks: 0x3100b 00010000:00010000:0.0:1789760706.787043:0:11801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.787058:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=310s v=(0 0) 00010000:00010000:0.0:1789760706.787063:0:11801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760706.787069:0:11801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.787084:0:11801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760706.864731:0:11801:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 102760448 -> 103809024 00002000:00010000:0.0:1789760706.864738:0:11801:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789760705 -> 1789760706 00002000:00010000:0.0:1789760706.864741:0:11801:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789760705 -> 1789760706 00002000:00010000:0.0:1789760706.864743:0:11801:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 200715 -> 202763 00010000:00010000:0.0:1789760706.864757:0:11801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.864770:0:11801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.864779:0:11801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.864837:0:11801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760706.864842:0:11801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.864860:0:11801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.864880:0:11801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4fc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.864888:0:11801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae4fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760706.865088:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967423 is committed 00000100:00100000:0.0:1789760706.865994:0:11801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863117184:12345-192.168.203.12@tcp:4:dd.500 Request processed in 79027us (220448us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1789760706.866006:0:11801:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 133 00000100:00100000:0.0:1789760706.866177:0:11801:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 310899912573 time 310900128281 state 0x2 ref 0 00000100:00100000:1.0:1789760706.873162:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760706.873287:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863117312 00000100:00100000:2.0:1789760706.873297:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863117312 00000100:00100000:2.0:1789760706.873350:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 310899912573 time 310900128281 state 0x0 ref 1 00000100:00100000:2.0:1789760706.873362:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 311100128281 time 310900128281 state 0x1 ref 1 00000100:00100000:0.0:1789760706.988431:0:6698:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 311100128281 time 311101615187 state 0x0 ref 1 00000100:00100000:0.0:1789760706.988466:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863117312:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760706.988522:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 103809024, mtime: 0x6aad94c2, atime: 0x6aad94ae, ctime: 0x6aad94c2, blocks: 0x3180b 00010000:00010000:0.0:1789760706.988531:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae503 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.988581:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=311s v=(0 0) 00010000:00010000:0.0:1789760706.988599:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760706.988607:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae503 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760706.988625:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae503 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760707.067265:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 103809024 -> 104857600 00002000:00010000:0.0:1789760707.067274:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 202763 -> 204811 00010000:00010000:0.0:1789760707.067289:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae503 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.067303:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae503 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.067312:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae503 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.067320:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760707.067325:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae503 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.067335:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae503 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.067374:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae503 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.067382:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae503 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760707.067481:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+7:2351:x1876699863117312:12345-192.168.203.12@tcp:4:dd.500 Request processed in 79027us (194324us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1789760707.067492:0:6698:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 134 00000100:00100000:0.0:1789760707.067500:0:6698:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 311100128281 time 311101615187 state 0x2 ref 0 00000001:00080000:2.0:1789760707.068037:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967424 is committed 00000100:00100000:1.0:1789760707.096686:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760707.096844:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863117568 00000100:00100000:3.0:1789760707.096854:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863117568 00000100:00080000:1.0:1789760707.097013:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760707.097140:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:3.0:1789760707.097150:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+8:10532:x1876699863117568:12345-192.168.203.12@tcp:35:dd.500 00000001:00080000:3.0:1789760707.097506:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967353 00000100:00100000:3.0:1789760707.097629:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+10:10532:x1876699863117568:12345-192.168.203.12@tcp:35:dd.500 Request processed in 479us (949us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1789760707.097637:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000020:00080000:3.0:1789760707.097642:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789760707.259548:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760707.259714:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863117824 00000100:00100000:0.0:1789760707.259724:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863117824 00000100:00100000:0.0:1789760707.259786:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:0.0:1789760707.259797:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df142e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+10:10550:x1876699863117824:12345-192.168.203.12@tcp:101:dd.500 00010000:00010000:0.0:1789760707.259857:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760707.259924:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66c00/0x3e099f5ef04ae50a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d1a3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.260001:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae511 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.260177:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae511 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.260193:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae511 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.260246:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae518 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.260254:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.260260:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.261358:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04ae51f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.261372:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04ae51f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.261381:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04ae51f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760707.261392:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 104857600 00010000:00010000:0.0:1789760707.261494:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae511 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.261503:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae511 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.261509:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae511 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.261514:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67a00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760707.262641:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae511 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.262672:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae511 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.262688:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df2502f3100) 00010000:00010000:0.0:1789760707.262691:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760707.262697:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae511 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.262704:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67a00/0x3e099f5ef04ae511 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.262720:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.262726:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae518 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.262732:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae518 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.262737:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67600 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760707.262740:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae518 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.262747:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae518 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.262754:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x4009f790 (ffff8df2502f3300) 00010000:00010000:0.0:1789760707.262756:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760707.262759:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae518 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.262776:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67600/0x3e099f5ef04ae518 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.262938:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66c00/0x3e099f5ef04ae50a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1a3 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.262955:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04ae51f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1a3 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.262963:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df25b60d100) 00010000:00010000:0.0:1789760707.262966:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789760707.262968:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df243a66a00, rc 0) 00000100:00100000:0.0:1789760707.263042:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df142e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+12:10550:x1876699863117824:12345-192.168.203.12@tcp:101:dd.500 Request processed in 3246us (3503us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1789760707.263051:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:3.0:1789760707.273894:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760707.274359:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863117952 00000100:00100000:0.0:1789760707.274370:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863117952 00000100:00100000:0.0:1789760707.274444:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:0.0:1789760707.274455:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14347c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863117952:12345-192.168.203.12@tcp:101:dd.500 00010000:00010000:0.0:1789760707.274475:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760707.274496:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059a05cf5/0x3e099f5ef04ae52d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d1aa expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760707.274534:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 104857600, mtime: 0x6aad94c2, atime: 0x6aad94ae, ctime: 0x6aad94c2, blocks: 0x3200b 00010000:00010000:0.0:1789760707.274554:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=311s v=(0 0) 00010000:00010000:0.0:1789760707.274559:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760707.274580:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059a05cf5/0x3e099f5ef04ae52d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1aa expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.274609:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000059a05cf5/0x3e099f5ef04ae52d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1aa expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.274622:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df243a67200, rc 0) 00000100:00100000:0.0:1789760707.274690:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14347c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863117952:12345-192.168.203.12@tcp:101:dd.500 Request processed in 236us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760707.274697:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00080000:1.0:1789760707.275038:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760707.295260:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760707.295464:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863118080 00000100:00100000:2.0:1789760707.295473:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863118080 00000100:00100000:2.0:1789760707.295539:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 311100128281 time 311101615187 state 0x0 ref 1 00000100:00100000:2.0:1789760707.295553:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 311301615187 time 311101615187 state 0x1 ref 1 00000100:00100000:2.0:1789760707.295593:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 311301615187 time 311408778438 state 0x0 ref 1 00000100:00100000:2.0:1789760707.295607:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863118080:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760707.295652:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000098bab9ef/0x3e099f5ef04ae534 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760707.295670:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760707.295675:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760707.295681:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098bab9ef/0x3e099f5ef04ae534 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760707.295695:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098bab9ef/0x3e099f5ef04ae534 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.345853:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000098bab9ef/0x3e099f5ef04ae534 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.345874:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098bab9ef/0x3e099f5ef04ae534 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.345883:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098bab9ef/0x3e099f5ef04ae534 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.345890:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2779b9a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760707.345895:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098bab9ef/0x3e099f5ef04ae534 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.345905:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098bab9ef/0x3e099f5ef04ae534 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.345925:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098bab9ef/0x3e099f5ef04ae534 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.345961:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098bab9ef/0x3e099f5ef04ae534 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760707.346084:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863118080:12345-192.168.203.12@tcp:3:dd.500 Request processed in 50475us (50828us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760707.346095:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 135 00000100:00100000:0.0:1789760707.346103:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 311301615187 time 311408778438 state 0x2 ref 0 00000100:00100000:2.0:1789760707.352405:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760707.352877:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863118208 00000100:00100000:0.0:1789760707.352887:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863118208 00000100:00100000:0.0:1789760707.352952:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 311301615187 time 311408778438 state 0x0 ref 1 00000100:00100000:0.0:1789760707.352966:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 311608778438 time 311408778438 state 0x1 ref 1 00000100:00100000:1.0:1789760707.495756:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 311608778438 time 311608942901 state 0x0 ref 1 00000100:00100000:1.0:1789760707.495839:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863118208:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760707.495887:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dad40572/0x3e099f5ef04ae53b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760707.495905:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760707.495909:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760707.495916:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dad40572/0x3e099f5ef04ae53b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760707.495930:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dad40572/0x3e099f5ef04ae53b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760707.559162:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dad40572/0x3e099f5ef04ae53b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760707.559202:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dad40572/0x3e099f5ef04ae53b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760707.559212:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dad40572/0x3e099f5ef04ae53b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760707.559218:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f077a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760707.559224:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dad40572/0x3e099f5ef04ae53b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760707.559233:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dad40572/0x3e099f5ef04ae53b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760707.559253:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dad40572/0x3e099f5ef04ae53b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760707.559261:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dad40572/0x3e099f5ef04ae53b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760707.559346:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863118208:12345-192.168.203.12@tcp:3:dd.500 Request processed in 63557us (206948us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760707.559356:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 136 00000100:00100000:3.0:1789760707.559363:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 311608778438 time 311608942901 state 0x2 ref 0 00000100:00100000:2.0:1789760707.563627:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760707.564027:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863118336 00000100:00100000:0.0:1789760707.564038:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863118336 00000100:00100000:0.0:1789760707.564088:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 311608778438 time 311608942901 state 0x0 ref 1 00000100:00100000:0.0:1789760707.564102:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 311808942901 time 311608942901 state 0x1 ref 1 00000100:00100000:3.0:1789760707.695858:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 311808942901 time 311809039862 state 0x0 ref 1 00000100:00100000:3.0:1789760707.696667:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863118336:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:3.0:1789760707.696710:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae542 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760707.696728:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760707.696732:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760707.696738:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae542 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760707.696752:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae542 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760707.717614:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967355 is committed 00010000:00010000:3.0:1789760707.727407:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae542 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760707.727427:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae542 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760707.727437:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae542 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760707.727445:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241675a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760707.727451:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae542 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760707.727475:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae542 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760707.727494:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae542 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760707.727502:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae542 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760707.727587:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863118336:12345-192.168.203.12@tcp:3:dd.500 Request processed in 31682us (163956us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760707.727597:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 137 00000100:00100000:3.0:1789760707.727605:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 311808942901 time 311809039862 state 0x2 ref 0 00000100:00100000:1.0:1789760707.732492:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760707.732549:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863118464 00000100:00100000:0.0:1789760707.732559:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863118464 00000100:00100000:0.0:1789760707.732624:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 311808942901 time 311809039862 state 0x0 ref 1 00000100:00100000:0.0:1789760707.732637:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 312009039862 time 311809039862 state 0x1 ref 1 00010000:00010000:3.0:1789760707.791186:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760707.903741:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 312009039862 time 312016927854 state 0x0 ref 1 00000100:00100000:0.0:1789760707.903772:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d030e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863118464:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760707.903845:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae549 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.903863:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789760707.903867:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760707.903873:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae549 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.903889:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae549 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.924403:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae549 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.924423:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae549 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.924433:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae549 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.924440:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760707.924445:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae549 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.924454:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae549 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.924492:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae549 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760707.924500:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae549 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760707.924889:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d030e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863118464:12345-192.168.203.12@tcp:3:dd.500 Request processed in 21125us (192403us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760707.924901:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 138 00000100:00100000:0.0:1789760707.924909:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 312009039862 time 312016927854 state 0x2 ref 0 00000100:00100000:1.0:1789760707.941358:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760707.941453:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863118592 00000100:00100000:0.0:1789760707.941463:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863118592 00000100:00100000:0.0:1789760707.941513:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 312009039862 time 312016927854 state 0x0 ref 1 00000100:00100000:0.0:1789760707.941525:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 312216927854 time 312016927854 state 0x1 ref 1 00000100:00100000:3.0:1789760708.103904:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 312216927854 time 312217091355 state 0x0 ref 1 00000100:00100000:3.0:1789760708.103936:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863118592:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:3.0:1789760708.103976:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae550 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760708.103992:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760708.103996:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760708.104001:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae550 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760708.104034:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae550 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760708.135880:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae550 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760708.135901:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae550 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760708.135911:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae550 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760708.135918:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241675a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760708.135923:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae550 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760708.135932:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae550 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760708.135952:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae550 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760708.135961:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f547bec/0x3e099f5ef04ae550 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760708.136159:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863118592:12345-192.168.203.12@tcp:3:dd.500 Request processed in 32232us (194804us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760708.136185:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 139 00000100:00100000:3.0:1789760708.136193:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 312216927854 time 312217091355 state 0x2 ref 0 00000100:00100000:2.0:1789760708.144827:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760708.144944:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863118720 00000100:00100000:0.0:1789760708.144955:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863118720 00000100:00100000:0.0:1789760708.145006:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 312216927854 time 312217091355 state 0x0 ref 1 00000100:00100000:0.0:1789760708.145029:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 312417091355 time 312217091355 state 0x1 ref 1 00000100:00100000:2.0:1789760708.213961:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760708.214382:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863118848 00000100:00100000:1.0:1789760708.214391:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863118848 00000100:00100000:1.0:1789760708.214449:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 261 00000100:00100000:1.0:1789760708.214458:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2348:x1876699863118848:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1789760708.214562:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2348:x1876699863118848:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 104us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760708.214596:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 261 00000100:00100000:3.0:1789760708.219426:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760708.219544:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863118976 00000100:00100000:0.0:1789760708.219554:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863118976 00000100:00100000:0.0:1789760708.219630:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:0.0:1789760708.219641:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14347dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+9:2348:x1876699863118976:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1789760708.219733:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14347dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+9:2348:x1876699863118976:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 94us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760708.219741:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:2.0:1789760708.241977:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760708.242038:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760708.242121:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863119232 00000100:00100000:3.0:1789760708.242131:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863119232 00000100:00100000:3.0:1789760708.242223:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:3.0:1789760708.242234:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d28d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2348:x1876699863119232:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760708.242310:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d28d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2348:x1876699863119232:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 78us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760708.242317:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00080000:2.0:1789760708.242962:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760708.243339:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863119104 00000100:00100000:1.0:1789760708.243346:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863119104 00000100:00100000:1.0:1789760708.243411:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:1.0:1789760708.243420:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d28d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2347:x1876699863119104:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:1.0:1789760708.243446:0:6695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e099f5ef04add77 00000100:00080000:1.0:1789760708.243457:0:6695:0:(import.c:65:import_set_state_nolock()) ffff8df1411e3000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789760708.243528:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967323 00000100:00100000:1.0:1789760708.243862:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d28d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+2:2347:x1876699863119104:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 440us (1893us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760708.243872:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00080000:2.0:1789760708.243990:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789760708.244468:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760708.304653:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 312417091355 time 312417837558 state 0x0 ref 1 00000100:00100000:3.0:1789760708.304685:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863118720:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:3.0:1789760708.304725:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae557 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760708.304740:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760708.304745:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760708.304751:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae557 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760708.304766:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae557 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760708.336882:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae557 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760708.336901:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae557 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760708.336911:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae557 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760708.336919:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760708.336924:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae557 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760708.336934:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae557 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760708.336952:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae557 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760708.336983:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0c58727/0x3e099f5ef04ae557 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760708.337078:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863118720:12345-192.168.203.12@tcp:3:dd.500 Request processed in 32405us (192292us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760708.337090:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 140 00000100:00100000:2.0:1789760708.337098:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 312417091355 time 312417837558 state 0x2 ref 0 00000100:00100000:3.0:1789760708.351688:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760708.351850:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863119360 00000100:00100000:2.0:1789760708.351860:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863119360 00000100:00100000:2.0:1789760708.351911:0:11799:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 312417091355 time 312417837558 state 0x0 ref 1 00000100:00100000:2.0:1789760708.351923:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 312617837558 time 312417837558 state 0x1 ref 1 00000100:00100000:0.0:1789760708.507979:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 312617837558 time 312621164770 state 0x0 ref 1 00000100:00100000:0.0:1789760708.508011:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14347c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863119360:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760708.508055:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae55e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760708.508072:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760708.508077:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760708.508084:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae55e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760708.508097:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae55e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760708.529270:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae55e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760708.529290:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae55e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760708.529373:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae55e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760708.529381:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760708.529386:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae55e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760708.529394:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae55e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760708.529413:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae55e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760708.529421:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae55e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760708.529543:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14347c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863119360:12345-192.168.203.12@tcp:3:dd.500 Request processed in 21542us (177859us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760708.529554:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 141 00000100:00100000:3.0:1789760708.529562:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 312617837558 time 312621164770 state 0x2 ref 0 00000100:00100000:2.0:1789760708.541457:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760708.541652:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863119488 00000100:00100000:3.0:1789760708.541676:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863119488 00000100:00100000:3.0:1789760708.541733:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 312617837558 time 312621164770 state 0x0 ref 1 00000100:00100000:3.0:1789760708.541745:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 312821164770 time 312621164770 state 0x1 ref 1 00000100:00100000:3.0:1789760708.711901:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 312821164770 time 312825086189 state 0x0 ref 1 00000100:00100000:3.0:1789760708.711936:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863119488:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:3.0:1789760708.711978:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae565 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760708.711996:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760708.712000:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760708.712007:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae565 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760708.712021:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae565 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760708.756227:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae565 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760708.757346:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae565 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760708.757357:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae565 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760708.757366:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760708.760871:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae565 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760708.760896:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae565 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760708.760925:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae565 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760708.760935:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000affad037/0x3e099f5ef04ae565 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760708.761722:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863119488:12345-192.168.203.12@tcp:3:dd.500 Request processed in 49791us (220266us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760708.761737:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 142 00000100:00100000:1.0:1789760708.761746:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 312821164770 time 312825086189 state 0x2 ref 0 00000100:00100000:1.0:1789760708.774980:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760708.775124:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863119616 00000100:00100000:0.0:1789760708.775136:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863119616 00000100:00100000:0.0:1789760708.775205:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 312821164770 time 312825086189 state 0x0 ref 1 00000100:00100000:0.0:1789760708.775219:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 313025086189 time 312825086189 state 0x1 ref 1 00010000:00010000:0.0:1789760708.816093:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760708.913096:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 313025086189 time 313026277199 state 0x0 ref 1 00000100:00100000:2.0:1789760708.913159:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d030700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863119616:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760708.913223:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aaf9a82b/0x3e099f5ef04ae56c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760708.913246:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789760708.913251:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760708.913260:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf9a82b/0x3e099f5ef04ae56c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760708.916459:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaf9a82b/0x3e099f5ef04ae56c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760708.949541:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aaf9a82b/0x3e099f5ef04ae56c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760708.949560:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf9a82b/0x3e099f5ef04ae56c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760708.949580:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaf9a82b/0x3e099f5ef04ae56c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760708.949588:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df246d1fe00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760708.949594:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf9a82b/0x3e099f5ef04ae56c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760708.949603:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf9a82b/0x3e099f5ef04ae56c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760708.949621:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaf9a82b/0x3e099f5ef04ae56c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760708.949629:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaf9a82b/0x3e099f5ef04ae56c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760708.949708:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d030700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863119616:12345-192.168.203.12@tcp:3:dd.500 Request processed in 36585us (174738us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760708.949719:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 143 00000100:00100000:2.0:1789760708.949738:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 313025086189 time 313026277199 state 0x2 ref 0 00000100:00100000:0.0:1789760708.954658:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760708.954741:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863119744 00000100:00100000:2.0:1789760708.954751:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863119744 00000100:00100000:2.0:1789760708.954855:0:11799:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 313025086189 time 313026277199 state 0x0 ref 1 00000100:00100000:2.0:1789760708.954868:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 313226277199 time 313026277199 state 0x1 ref 1 00000100:00100000:3.0:1789760709.113519:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 313226277199 time 313226704396 state 0x0 ref 1 00000100:00100000:3.0:1789760709.113584:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863119744:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:3.0:1789760709.113624:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae573 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760709.113645:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760709.113659:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760709.113666:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae573 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760709.113681:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae573 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789760709.114238:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789760709.134418:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae573 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760709.134450:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae573 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760709.134460:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae573 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760709.134468:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760709.134473:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae573 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760709.134482:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae573 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760709.134501:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae573 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760709.134509:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04ae573 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760709.134613:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863119744:12345-192.168.203.12@tcp:3:dd.500 Request processed in 21069us (179960us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760709.134624:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 144 00000100:00100000:3.0:1789760709.134632:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 313226277199 time 313226704396 state 0x2 ref 0 00000100:00100000:0.0:1789760709.155208:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760709.155635:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863119872 00000100:00100000:3.0:1789760709.155657:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863119872 00000100:00100000:3.0:1789760709.155708:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 313226277199 time 313226704396 state 0x0 ref 1 00000100:00100000:3.0:1789760709.155721:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 313426704396 time 313226704396 state 0x1 ref 1 00000100:00100000:2.0:1789760709.199129:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14347ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883043584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760709.199199:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760709.199342:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883043584 00000100:00100000:1.0:1789760709.199350:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883043584 00000100:00100000:1.0:1789760709.199411:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789760709.199420:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d28f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883043584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789760709.199454:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241893376 pending 0 free 3754950656 avail 3752853504 00000100:00100000:1.0:1789760709.199498:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d28f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883043584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760709.199504:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1789760709.199794:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760709.199945:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14347ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883043584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760709.313765:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 313426704396 time 313426948048 state 0x0 ref 1 00000100:00100000:1.0:1789760709.313862:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863119872:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760709.313905:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000019241b0b/0x3e099f5ef04ae57a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760709.313920:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760709.313924:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760709.313930:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019241b0b/0x3e099f5ef04ae57a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760709.313943:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019241b0b/0x3e099f5ef04ae57a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760709.342892:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000019241b0b/0x3e099f5ef04ae57a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760709.342913:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019241b0b/0x3e099f5ef04ae57a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760709.342923:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019241b0b/0x3e099f5ef04ae57a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760709.342931:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25b6f0c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760709.342935:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019241b0b/0x3e099f5ef04ae57a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760709.342945:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019241b0b/0x3e099f5ef04ae57a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760709.342980:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019241b0b/0x3e099f5ef04ae57a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760709.342988:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019241b0b/0x3e099f5ef04ae57a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760709.343082:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863119872:12345-192.168.203.12@tcp:3:dd.500 Request processed in 29229us (187877us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760709.343092:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 145 00000100:00100000:1.0:1789760709.343100:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 313426704396 time 313426948048 state 0x2 ref 0 00000100:00100000:2.0:1789760709.348194:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760709.348304:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863120000 00000100:00100000:0.0:1789760709.348327:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863120000 00000100:00100000:0.0:1789760709.348380:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 313426704396 time 313426948048 state 0x0 ref 1 00000100:00100000:0.0:1789760709.348394:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 313626948048 time 313426948048 state 0x1 ref 1 00000100:00100000:2.0:1789760709.517962:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 313626948048 time 313631146041 state 0x0 ref 1 00000100:00100000:2.0:1789760709.519370:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d28c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863120000:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760709.519427:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ca931cf6/0x3e099f5ef04ae581 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760709.519445:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760709.519450:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760709.519456:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca931cf6/0x3e099f5ef04ae581 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760709.519614:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca931cf6/0x3e099f5ef04ae581 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760709.593111:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ca931cf6/0x3e099f5ef04ae581 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760709.593135:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca931cf6/0x3e099f5ef04ae581 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760709.593144:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca931cf6/0x3e099f5ef04ae581 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760709.593152:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517bba00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760709.593157:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca931cf6/0x3e099f5ef04ae581 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760709.593167:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca931cf6/0x3e099f5ef04ae581 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760709.593186:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca931cf6/0x3e099f5ef04ae581 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760709.593193:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca931cf6/0x3e099f5ef04ae581 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760709.593286:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d28c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863120000:12345-192.168.203.12@tcp:3:dd.500 Request processed in 75299us (245095us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760709.593314:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 146 00000100:00100000:0.0:1789760709.593325:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 313626948048 time 313631146041 state 0x2 ref 0 00000100:00100000:3.0:1789760709.603019:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760709.603225:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863120128 00000100:00100000:2.0:1789760709.603237:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863120128 00000100:00100000:2.0:1789760709.603292:0:11799:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 313626948048 time 313631146041 state 0x0 ref 1 00000100:00100000:2.0:1789760709.603305:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 313831146041 time 313631146041 state 0x1 ref 1 00000100:00100000:3.0:1789760709.718214:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 313831146041 time 313831400832 state 0x0 ref 1 00000100:00100000:3.0:1789760709.718247:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14347d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863120128:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:3.0:1789760709.718288:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012056ae5/0x3e099f5ef04ae588 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760709.718305:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760709.718310:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760709.718315:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012056ae5/0x3e099f5ef04ae588 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760709.718329:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012056ae5/0x3e099f5ef04ae588 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760709.736443:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012056ae5/0x3e099f5ef04ae588 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760709.736462:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012056ae5/0x3e099f5ef04ae588 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760709.736472:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012056ae5/0x3e099f5ef04ae588 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760709.736480:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df246d1fa00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760709.736485:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012056ae5/0x3e099f5ef04ae588 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760709.736495:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012056ae5/0x3e099f5ef04ae588 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760709.736513:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012056ae5/0x3e099f5ef04ae588 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760709.736521:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012056ae5/0x3e099f5ef04ae588 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760709.749360:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14347d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863120128:12345-192.168.203.12@tcp:3:dd.500 Request processed in 31117us (146341us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760709.749392:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 147 00000100:00100000:0.0:1789760709.749401:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 313831146041 time 313831400832 state 0x2 ref 0 00000100:00100000:2.0:1789760709.764923:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760709.765383:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863120256 00000100:00100000:3.0:1789760709.765393:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863120256 00000100:00100000:3.0:1789760709.765442:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 313831146041 time 313831400832 state 0x0 ref 1 00000100:00100000:3.0:1789760709.765455:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 314031400832 time 313831400832 state 0x1 ref 1 00010000:00010000:3.0:1789760709.840171:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760709.918361:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 314031400832 time 314031548210 state 0x0 ref 1 00000100:00100000:1.0:1789760709.918396:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d28fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863120256:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760709.918440:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000035cf75af/0x3e099f5ef04ae58f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760709.918458:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789760709.918462:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760709.918469:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035cf75af/0x3e099f5ef04ae58f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760709.918486:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035cf75af/0x3e099f5ef04ae58f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760709.935642:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000035cf75af/0x3e099f5ef04ae58f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760709.935679:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035cf75af/0x3e099f5ef04ae58f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760709.935688:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035cf75af/0x3e099f5ef04ae58f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760709.935696:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25b6f1a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760709.935701:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035cf75af/0x3e099f5ef04ae58f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760709.935712:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035cf75af/0x3e099f5ef04ae58f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760709.935733:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035cf75af/0x3e099f5ef04ae58f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760709.935741:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035cf75af/0x3e099f5ef04ae58f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760709.935865:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d28fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863120256:12345-192.168.203.12@tcp:3:dd.500 Request processed in 17482us (170946us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760709.935875:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 148 00000100:00100000:3.0:1789760709.935883:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 314031400832 time 314031548210 state 0x2 ref 0 00000100:00100000:1.0:1789760709.945891:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760709.946033:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863120384 00000100:00100000:0.0:1789760709.946044:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863120384 00000100:00100000:0.0:1789760709.946095:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 314031400832 time 314031548210 state 0x0 ref 1 00000100:00100000:0.0:1789760709.946107:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 314231548210 time 314031548210 state 0x1 ref 1 00000100:00100000:0.0:1789760710.118486:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 314231548210 time 314231672311 state 0x0 ref 1 00000100:00100000:0.0:1789760710.118520:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d033480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863120384:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760710.118574:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae596 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.118591:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760710.118596:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760710.118602:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae596 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.118616:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae596 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.144335:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae596 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.144355:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae596 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.144377:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae596 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.144385:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df251688e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760710.144391:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae596 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.144401:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae596 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.144422:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae596 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.144430:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae596 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760710.144516:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d033480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863120384:12345-192.168.203.12@tcp:3:dd.500 Request processed in 26007us (198630us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760710.144526:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 149 00000100:00100000:0.0:1789760710.144534:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 314231548210 time 314231672311 state 0x2 ref 0 00000100:00100000:2.0:1789760710.161251:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760710.162881:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863120512 00000100:00100000:3.0:1789760710.162914:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863120512 00000100:00100000:3.0:1789760710.163051:0:11799:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 314231548210 time 314231672311 state 0x0 ref 1 00000100:00100000:3.0:1789760710.163066:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 314431672311 time 314231672311 state 0x1 ref 1 00000100:00100000:0.0:1789760710.318974:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 314431672311 time 314432159055 state 0x0 ref 1 00000100:00100000:0.0:1789760710.319007:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863120512:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760710.319053:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae59d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.319086:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760710.319089:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760710.319096:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae59d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.319110:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae59d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.328116:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae59d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.328146:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae59d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.328155:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae59d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.328162:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df251688e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760710.328167:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae59d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.328175:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae59d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.328192:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae59d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.328220:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae59d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760710.328496:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863120512:12345-192.168.203.12@tcp:3:dd.500 Request processed in 9501us (167253us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760710.328507:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 150 00000100:00100000:0.0:1789760710.328590:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 314431672311 time 314432159055 state 0x2 ref 0 00000100:00100000:2.0:1789760710.334112:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760710.334285:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863120640 00000100:00100000:3.0:1789760710.334296:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863120640 00000100:00100000:3.0:1789760710.334347:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 314431672311 time 314432159055 state 0x0 ref 1 00000100:00100000:3.0:1789760710.334360:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 314632159055 time 314432159055 state 0x1 ref 1 00000100:00100000:3.0:1789760710.519092:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 314632159055 time 314632277343 state 0x0 ref 1 00000100:00100000:3.0:1789760710.519974:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863120640:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:3.0:1789760710.520018:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008e804854/0x3e099f5ef04ae5a4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760710.520036:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760710.520040:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760710.520046:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e804854/0x3e099f5ef04ae5a4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760710.520060:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e804854/0x3e099f5ef04ae5a4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760710.540729:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008e804854/0x3e099f5ef04ae5a4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760710.540750:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e804854/0x3e099f5ef04ae5a4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760710.540760:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e804854/0x3e099f5ef04ae5a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760710.540768:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df246d1f200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760710.540773:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e804854/0x3e099f5ef04ae5a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760710.540793:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e804854/0x3e099f5ef04ae5a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760710.540838:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e804854/0x3e099f5ef04ae5a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760710.540847:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e804854/0x3e099f5ef04ae5a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760710.540949:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863120640:12345-192.168.203.12@tcp:3:dd.500 Request processed in 21833us (206842us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760710.540978:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 151 00000100:00100000:1.0:1789760710.540986:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 314632159055 time 314632277343 state 0x2 ref 0 00000100:00100000:2.0:1789760710.549983:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760710.550062:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863120768 00000100:00100000:0.0:1789760710.550072:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863120768 00000100:00100000:0.0:1789760710.550134:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 314632159055 time 314632277343 state 0x0 ref 1 00000100:00100000:0.0:1789760710.550147:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 314832277343 time 314632277343 state 0x1 ref 1 00000100:00100000:0.0:1789760710.719195:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 314832277343 time 314832381635 state 0x0 ref 1 00000100:00100000:0.0:1789760710.719227:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863120768:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760710.719272:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae5ab lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.719289:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760710.719294:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760710.719300:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae5ab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.719313:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae5ab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.733609:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae5ab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.733630:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae5ab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.733932:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae5ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.733942:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df251688e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760710.733946:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae5ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.733956:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae5ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.733976:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae5ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.733985:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae5ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760710.734109:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863120768:12345-192.168.203.12@tcp:3:dd.500 Request processed in 14893us (184133us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760710.734117:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 152 00000100:00100000:0.0:1789760710.734137:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 314832277343 time 314832381635 state 0x2 ref 0 00000100:00100000:0.0:1789760710.736009:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d031f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e2780560-8e82-4256-94b0-2e524f3bed06:3309:1876699883043712:0@lo:400:kworker.0 00000100:00100000:0.0:1789760710.736078:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760710.736173:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883043712 00000100:00100000:2.0:1789760710.736183:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883043712 00000100:00100000:2.0:1789760710.736237:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789760710.736246:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3309:x1876699883043712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760710.736408:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883044096:0@lo:400:kworker.0 00000100:00100000:3.0:1789760710.736441:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760710.736477:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883044096 00000100:00100000:3.0:1789760710.736481:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883044096 00000100:00100000:3.0:1789760710.736522:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789760710.736528:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14347ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883044096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760710.736586:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14347ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883044096:12345-0@lo:400:kworker.0 Request processed in 58us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760710.736593:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789760710.736634:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883044096:0@lo:400:kworker.0 00000100:00100000:3.0:1789760710.736677:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876699883043840:0@lo:400:kworker.0 00000100:00100000:3.0:1789760710.736713:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760710.736733:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789760710.736738:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d031880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1876699883043968:0@lo:400:kworker.0 00000100:00100000:3.0:1789760710.736768:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760710.736824:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883043840 00000100:00100000:3.0:1789760710.736828:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883043840 00000100:00100000:3.0:1789760710.736852:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883043968 00000100:00100000:3.0:1789760710.736855:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883043968 00000100:00100000:3.0:1789760710.736883:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789760710.736889:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26cede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876699883043840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760710.736923:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26cede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876699883043840:12345-0@lo:400:kworker.0 Request processed in 35us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760710.736929:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789760710.736941:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789760710.736946:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26ceddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876699883043968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760710.736972:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26ceddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876699883043968:12345-0@lo:400:kworker.0 Request processed in 27us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760710.736978:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789760710.737009:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d031880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1876699883043968:0@lo:400:kworker.0 00000100:00100000:3.0:1789760710.737029:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876699883043840:0@lo:400:kworker.0 00000100:00080000:3.0:1789760710.737061:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760710.737366:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3309:x1876699883043712:12345-0@lo:400:kworker.0 Request processed in 1120us (1286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760710.737374:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789760710.737427:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883044352:0@lo:400:kworker.0 00000100:00100000:3.0:1789760710.737750:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789760710.737758:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1876699883044224:0@lo:400:kworker.0 00000100:00100000:3.0:1789760710.737788:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760710.737830:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883044224 00000100:00100000:1.0:1789760710.737835:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883044224 00000100:00100000:1.0:1789760710.737884:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789760710.737891:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26cedd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876699883044224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760710.737936:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26cedd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876699883044224:12345-0@lo:400:kworker.0 Request processed in 45us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760710.737942:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789760710.737976:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1876699883044224:0@lo:400:kworker.0 00000100:00080000:3.0:1789760710.738794:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760710.739252:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d031f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e2780560-8e82-4256-94b0-2e524f3bed06:3309:1876699883043712:0@lo:400:kworker.0 00000100:00100000:2.0:1789760710.739500:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760710.739502:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760710.739594:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883044352 00000100:00100000:1.0:1789760710.739601:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883044352 00000100:00100000:1.0:1789760710.739663:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789760710.739671:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d28d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883044352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760710.739721:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d28d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883044352:12345-0@lo:400:kworker.0 Request processed in 50us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760710.739728:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1789760710.739879:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789760710.739929:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863120896 00000100:00100000:0.0:1789760710.739934:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863120896 00000100:00100000:0.0:1789760710.739971:0:11799:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 314832277343 time 314832381635 state 0x0 ref 1 00000100:00100000:0.0:1789760710.739983:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 315032381635 time 314832381635 state 0x1 ref 1 00000100:00100000:2.0:1789760710.740009:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883044352:0@lo:400:kworker.0 00010000:00010000:0.0:1789760710.863127:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760710.919330:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 315032381635 time 315032515715 state 0x0 ref 1 00000100:00100000:0.0:1789760710.919364:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26cedd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863120896:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760710.919415:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae5b2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.919431:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789760710.919435:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760710.919441:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae5b2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.919457:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae5b2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.931851:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae5b2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.931889:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae5b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.931899:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae5b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.931908:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df251688e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760710.931913:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae5b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.931922:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae5b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.931954:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae5b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760710.931962:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae5b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760710.932043:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26cedd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863120896:12345-192.168.203.12@tcp:3:dd.500 Request processed in 12690us (192537us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760710.932053:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 153 00000100:00100000:0.0:1789760710.932061:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 315032381635 time 315032515715 state 0x2 ref 0 00000100:00100000:3.0:1789760710.943729:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760710.943836:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863121024 00000100:00100000:1.0:1789760710.943847:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863121024 00000100:00100000:1.0:1789760710.943906:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 315032381635 time 315032515715 state 0x0 ref 1 00000100:00100000:1.0:1789760710.943919:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 315232515715 time 315032515715 state 0x1 ref 1 00000100:00100000:1.0:1789760711.122003:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 315232515715 time 315235187447 state 0x0 ref 1 00000100:00100000:1.0:1789760711.122058:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26cedca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863121024:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760711.122125:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c110edf0/0x3e099f5ef04ae5b9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760711.122142:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760711.122146:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760711.122153:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c110edf0/0x3e099f5ef04ae5b9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760711.122168:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c110edf0/0x3e099f5ef04ae5b9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789760711.122956:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789760711.146447:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c110edf0/0x3e099f5ef04ae5b9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760711.146467:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c110edf0/0x3e099f5ef04ae5b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760711.146477:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c110edf0/0x3e099f5ef04ae5b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760711.146484:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2504cbe00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760711.146489:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c110edf0/0x3e099f5ef04ae5b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760711.146499:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c110edf0/0x3e099f5ef04ae5b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760711.146543:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c110edf0/0x3e099f5ef04ae5b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760711.146551:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c110edf0/0x3e099f5ef04ae5b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760711.146650:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26cedca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863121024:12345-192.168.203.12@tcp:3:dd.500 Request processed in 24626us (202926us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760711.146660:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 154 00000100:00100000:1.0:1789760711.146667:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 315232515715 time 315235187447 state 0x2 ref 0 00000100:00100000:3.0:1789760711.154549:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760711.158744:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863121152 00000100:00100000:0.0:1789760711.158773:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863121152 00000100:00100000:0.0:1789760711.158905:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 315232515715 time 315235187447 state 0x0 ref 1 00000100:00100000:0.0:1789760711.158920:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 315435187447 time 315235187447 state 0x1 ref 1 00000100:00100000:0.0:1789760711.247170:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26cedc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883044480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760711.247241:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760711.249469:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883044480 00000100:00100000:1.0:1789760711.249486:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883044480 00000100:00100000:1.0:1789760711.249573:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789760711.249583:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883044480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789760711.249627:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760711.249719:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883044480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (2477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760711.249726:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789760711.249855:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26cedc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883044480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760711.322118:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 315435187447 time 315435302516 state 0x0 ref 1 00000100:00100000:0.0:1789760711.322157:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26cedf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863121152:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760711.322204:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae5c0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760711.322223:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760711.322227:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760711.322232:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae5c0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760711.322247:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae5c0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760711.378489:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae5c0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760711.378511:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae5c0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760711.378536:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae5c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760711.378562:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df251688e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760711.378567:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae5c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760711.378576:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae5c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760711.378773:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae5c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760711.378783:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088be2771/0x3e099f5ef04ae5c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760711.378925:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26cedf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863121152:12345-192.168.203.12@tcp:3:dd.500 Request processed in 56782us (224383us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760711.378936:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 155 00000100:00100000:0.0:1789760711.378944:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 315435187447 time 315435302516 state 0x2 ref 0 00000100:00100000:3.0:1789760711.383972:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760711.389500:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863121280 00000100:00100000:0.0:1789760711.389519:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863121280 00000100:00100000:0.0:1789760711.389651:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 315435187447 time 315435302516 state 0x0 ref 1 00000100:00100000:0.0:1789760711.389665:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 315635302516 time 315435302516 state 0x1 ref 1 00000100:00100000:0.0:1789760711.522228:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 315635302516 time 315635414826 state 0x0 ref 1 00000100:00100000:0.0:1789760711.522261:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26cedce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863121280:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760711.522301:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae5c7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760711.522316:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760711.522320:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760711.522325:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae5c7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760711.522338:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae5c7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760711.543688:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae5c7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760711.543707:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae5c7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760711.543717:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae5c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760711.543724:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760711.543729:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae5c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760711.543758:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae5c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760711.543784:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae5c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760711.543793:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae5c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760711.543889:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26cedce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863121280:12345-192.168.203.12@tcp:3:dd.500 Request processed in 21639us (159920us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760711.543898:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 156 00000100:00100000:0.0:1789760711.543905:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 315635302516 time 315635414826 state 0x2 ref 0 00000100:00100000:3.0:1789760711.557987:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760711.558368:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863121408 00000100:00100000:1.0:1789760711.558378:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863121408 00000100:00100000:1.0:1789760711.558432:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 315635302516 time 315635414826 state 0x0 ref 1 00000100:00100000:1.0:1789760711.558444:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 315835414826 time 315635414826 state 0x1 ref 1 00000100:00100000:1.0:1789760711.722341:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 315835414826 time 315835526344 state 0x0 ref 1 00000100:00100000:1.0:1789760711.722390:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26cedea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863121408:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760711.722450:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000a8fd69d/0x3e099f5ef04ae5ce lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760711.722470:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760711.722474:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760711.722480:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a8fd69d/0x3e099f5ef04ae5ce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760711.722494:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a8fd69d/0x3e099f5ef04ae5ce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760711.754401:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000a8fd69d/0x3e099f5ef04ae5ce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760711.754420:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a8fd69d/0x3e099f5ef04ae5ce lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760711.754430:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a8fd69d/0x3e099f5ef04ae5ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760711.754438:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2504cac00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760711.754443:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a8fd69d/0x3e099f5ef04ae5ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760711.754453:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a8fd69d/0x3e099f5ef04ae5ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760711.754486:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a8fd69d/0x3e099f5ef04ae5ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760711.754494:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a8fd69d/0x3e099f5ef04ae5ce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760711.754579:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26cedea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863121408:12345-192.168.203.12@tcp:3:dd.500 Request processed in 32200us (196605us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760711.754590:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 157 00000100:00100000:1.0:1789760711.754598:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 315835414826 time 315835526344 state 0x2 ref 0 00000100:00100000:3.0:1789760711.772390:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760711.772561:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863121536 00000100:00100000:2.0:1789760711.772572:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863121536 00000100:00100000:2.0:1789760711.772626:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 315835414826 time 315835526344 state 0x0 ref 1 00000100:00100000:2.0:1789760711.772650:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 316035526344 time 315835526344 state 0x1 ref 1 00010000:00010000:0.0:1789760711.886916:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760711.922558:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 316035526344 time 316035735460 state 0x0 ref 1 00000100:00100000:0.0:1789760711.922596:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26cedc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863121536:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760711.922652:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae5d5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760711.922669:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789760711.922674:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760711.922681:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae5d5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760711.922720:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae5d5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760711.949520:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae5d5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760711.949561:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae5d5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760711.949572:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae5d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760711.949580:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760711.949585:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae5d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760711.949594:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae5d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760711.949614:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae5d5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760711.949621:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b5ad0bf/0x3e099f5ef04ae5d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760711.949745:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26cedc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863121536:12345-192.168.203.12@tcp:3:dd.500 Request processed in 27164us (177363us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760711.949756:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 158 00000100:00100000:2.0:1789760711.949763:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 316035526344 time 316035735460 state 0x2 ref 0 00000100:00100000:3.0:1789760711.966057:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760711.967699:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863121664 00000100:00100000:0.0:1789760711.967713:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863121664 00000100:00100000:0.0:1789760711.967853:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 316035526344 time 316035735460 state 0x0 ref 1 00000100:00100000:0.0:1789760711.967867:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 316235735460 time 316035735460 state 0x1 ref 1 00000100:00100000:0.0:1789760712.122716:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 316235735460 time 316235902841 state 0x0 ref 1 00000100:00100000:0.0:1789760712.122751:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26cedf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863121664:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760712.122791:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae5dc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760712.122850:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760712.122855:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760712.122861:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae5dc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760712.122875:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae5dc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760712.140407:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae5dc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760712.140447:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae5dc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760712.140457:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae5dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760712.140465:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f077c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760712.140470:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae5dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760712.140480:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae5dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760712.140499:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae5dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760712.140508:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae5dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760712.140602:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26cedf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863121664:12345-192.168.203.12@tcp:3:dd.500 Request processed in 17863us (174550us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760712.140612:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 159 00000100:00100000:0.0:1789760712.140620:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 316235735460 time 316235902841 state 0x2 ref 0 00000100:00100000:3.0:1789760712.150261:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760712.150772:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863121792 00000100:00100000:1.0:1789760712.150785:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863121792 00000100:00100000:1.0:1789760712.150865:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 316235735460 time 316235902841 state 0x0 ref 1 00000100:00100000:1.0:1789760712.150888:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 316435902841 time 316235902841 state 0x1 ref 1 00000100:00100000:1.0:1789760712.322855:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 316435902841 time 316436041102 state 0x0 ref 1 00000100:00100000:1.0:1789760712.322890:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26ceddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863121792:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760712.322933:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000a8fd69d/0x3e099f5ef04ae5e3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760712.322950:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760712.322955:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760712.322961:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a8fd69d/0x3e099f5ef04ae5e3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760712.322990:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a8fd69d/0x3e099f5ef04ae5e3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760712.334021:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000a8fd69d/0x3e099f5ef04ae5e3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760712.334043:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a8fd69d/0x3e099f5ef04ae5e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760712.334053:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a8fd69d/0x3e099f5ef04ae5e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760712.334059:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2504cac00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760712.334064:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a8fd69d/0x3e099f5ef04ae5e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760712.334073:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a8fd69d/0x3e099f5ef04ae5e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760712.334092:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a8fd69d/0x3e099f5ef04ae5e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760712.334100:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a8fd69d/0x3e099f5ef04ae5e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760712.334198:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26ceddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863121792:12345-192.168.203.12@tcp:3:dd.500 Request processed in 11320us (183940us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760712.334209:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 160 00000100:00100000:1.0:1789760712.334218:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 316435902841 time 316436041102 state 0x2 ref 0 00000100:00100000:3.0:1789760712.338899:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760712.338970:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863121920 00000100:00100000:0.0:1789760712.338992:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863121920 00000100:00100000:0.0:1789760712.339039:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 316435902841 time 316436041102 state 0x0 ref 1 00000100:00100000:0.0:1789760712.339052:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 316636041102 time 316436041102 state 0x1 ref 1 00000100:00100000:2.0:1789760712.523007:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 316636041102 time 316636193402 state 0x0 ref 1 00000100:00100000:2.0:1789760712.523052:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26cede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863121920:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760712.523094:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c90f8450/0x3e099f5ef04ae5ea lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760712.523111:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760712.523115:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760712.523122:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c90f8450/0x3e099f5ef04ae5ea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760712.523136:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c90f8450/0x3e099f5ef04ae5ea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760712.556428:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c90f8450/0x3e099f5ef04ae5ea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760712.556448:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c90f8450/0x3e099f5ef04ae5ea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760712.556457:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c90f8450/0x3e099f5ef04ae5ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760712.556464:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df274a78800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760712.556469:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c90f8450/0x3e099f5ef04ae5ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760712.556478:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c90f8450/0x3e099f5ef04ae5ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760712.556499:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c90f8450/0x3e099f5ef04ae5ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760712.556507:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c90f8450/0x3e099f5ef04ae5ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760712.556608:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26cede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863121920:12345-192.168.203.12@tcp:3:dd.500 Request processed in 33563us (217715us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760712.556631:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 161 00000100:00100000:0.0:1789760712.556638:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 316636041102 time 316636193402 state 0x2 ref 0 00000100:00100000:3.0:1789760712.560479:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760712.560743:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863122048 00000100:00100000:0.0:1789760712.560754:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863122048 00000100:00100000:0.0:1789760712.562371:0:11799:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 316636041102 time 316636193402 state 0x0 ref 1 00000100:00100000:0.0:1789760712.562387:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 316836193402 time 316636193402 state 0x1 ref 1 00000100:00100000:0.0:1789760712.723637:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 316836193402 time 316836823899 state 0x0 ref 1 00000100:00100000:0.0:1789760712.723668:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26cedd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863122048:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760712.723707:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002ad22742/0x3e099f5ef04ae5f1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760712.723725:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760712.723729:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760712.723735:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ad22742/0x3e099f5ef04ae5f1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760712.723747:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ad22742/0x3e099f5ef04ae5f1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760712.739300:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002ad22742/0x3e099f5ef04ae5f1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760712.739319:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ad22742/0x3e099f5ef04ae5f1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760712.739343:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ad22742/0x3e099f5ef04ae5f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760712.739351:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df274a7ac00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760712.739366:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ad22742/0x3e099f5ef04ae5f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760712.739376:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ad22742/0x3e099f5ef04ae5f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760712.739394:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ad22742/0x3e099f5ef04ae5f1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760712.739403:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ad22742/0x3e099f5ef04ae5f1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760712.739483:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26cedd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863122048:12345-192.168.203.12@tcp:3:dd.500 Request processed in 15825us (179010us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760712.739494:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 162 00000100:00100000:0.0:1789760712.739503:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 316836193402 time 316836823899 state 0x2 ref 0 00000100:00100000:3.0:1789760712.752055:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760712.752254:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863122176 00000100:00100000:0.0:1789760712.752265:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863122176 00000100:00100000:0.0:1789760712.752320:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 316836193402 time 316836823899 state 0x0 ref 1 00000100:00100000:0.0:1789760712.752334:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 317036823899 time 316836823899 state 0x1 ref 1 00000001:00100000:3.0:1789760712.862497:0:7658:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1da0113a-370d-4d79-883c-54efc174697f 00000020:00000080:3.0:1789760712.862504:0:7658:0:(genops.c:885:class_export_put()) final put ffff8df1411e7800/1da0113a-370d-4d79-883c-54efc174697f 00000020:00000080:0.0:1789760712.862582:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df1411e7800/1da0113a-370d-4d79-883c-54efc174697f for lustre-OST0001 00000020:00000080:0.0:1789760712.862695:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df1411e3000 for lustre-OST0001 00010000:00010000:3.0:1789760712.911549:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760712.931141:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 317036823899 time 317044325380 state 0x0 ref 1 00000100:00100000:1.0:1789760712.931186:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26ceded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863122176:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760712.931494:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000067f3636d/0x3e099f5ef04ae5f8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760712.931512:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789760712.931517:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760712.931523:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067f3636d/0x3e099f5ef04ae5f8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760712.931537:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067f3636d/0x3e099f5ef04ae5f8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760712.965241:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000067f3636d/0x3e099f5ef04ae5f8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760712.965263:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067f3636d/0x3e099f5ef04ae5f8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760712.965293:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067f3636d/0x3e099f5ef04ae5f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760712.965301:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2504cba00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760712.965306:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067f3636d/0x3e099f5ef04ae5f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760712.965314:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067f3636d/0x3e099f5ef04ae5f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760712.965334:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067f3636d/0x3e099f5ef04ae5f8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760712.965341:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067f3636d/0x3e099f5ef04ae5f8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760712.965443:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26ceded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863122176:12345-192.168.203.12@tcp:3:dd.500 Request processed in 34278us (213392us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760712.965453:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 163 00000100:00100000:1.0:1789760712.965463:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 317036823899 time 317044325380 state 0x2 ref 0 00000100:00100000:3.0:1789760712.977968:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760712.978437:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863122304 00000100:00100000:0.0:1789760712.978449:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863122304 00000100:00100000:0.0:1789760712.978507:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 317036823899 time 317044325380 state 0x0 ref 1 00000100:00100000:0.0:1789760712.978519:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 317244325380 time 317044325380 state 0x1 ref 1 00000100:00100000:0.0:1789760713.131289:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 317244325380 time 317244475246 state 0x0 ref 1 00000100:00100000:0.0:1789760713.131345:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26cedc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863122304:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760713.131392:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae5ff lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.131409:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760713.131413:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760713.131418:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae5ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.131431:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae5ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789760713.132302:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789760713.145873:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae5ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.145893:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae5ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.145901:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae5ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.145916:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f077c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760713.145921:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae5ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.145930:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae5ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.145963:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae5ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.145979:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae5ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760713.146067:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26cedc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863122304:12345-192.168.203.12@tcp:3:dd.500 Request processed in 14755us (168105us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760713.146077:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 164 00000100:00100000:2.0:1789760713.146085:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 317244325380 time 317244475246 state 0x2 ref 0 00000100:00100000:3.0:1789760713.151943:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760713.152051:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863122432 00000100:00100000:0.0:1789760713.152062:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863122432 00000100:00100000:0.0:1789760713.152130:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 317244325380 time 317244475246 state 0x0 ref 1 00000100:00100000:0.0:1789760713.152143:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 317444475246 time 317244475246 state 0x1 ref 1 00000100:00100000:0.0:1789760713.333026:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 317444475246 time 317446211523 state 0x0 ref 1 00000100:00100000:0.0:1789760713.333071:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26cedf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863122432:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760713.333117:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae606 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.333134:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760713.333140:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760713.333147:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae606 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.333161:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae606 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760713.348701:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760713.348746:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760713.348785:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760713.348960:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863122560 00000100:00100000:2.0:1789760713.348971:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863122560 00000100:00100000:2.0:1789760713.349030:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 263 00000100:00100000:2.0:1789760713.349040:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2348:x1876699863122560:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1789760713.349121:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2348:x1876699863122560:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 82us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760713.349129:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 263 00000100:00100000:3.0:1789760713.352754:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863122688 00000100:00100000:3.0:1789760713.352768:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863122688 00000100:00100000:0.0:1789760713.352769:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863122816 00000100:00100000:0.0:1789760713.352772:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863122816 00000100:00100000:0.0:1789760713.352867:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 129 00000100:00080000:2.0:1789760713.352923:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760713.355437:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 130 00000100:00100000:3.0:1789760713.355467:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+9:2348:x1876699863122688:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760713.355563:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+9:2348:x1876699863122688:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 101us (6872us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760713.355571:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 130 00000100:00100000:0.0:1789760713.358420:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2348:x1876699863122816:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1789760713.358513:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2348:x1876699863122816:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 5637us (9727us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760713.358523:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 129 00010000:00010000:0.0:1789760713.375612:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae606 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.375631:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae606 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.375650:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae606 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.375657:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760713.375661:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae606 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.375670:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae606 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.375690:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae606 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.375697:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae606 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760713.376258:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26cedf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863122432:12345-192.168.203.12@tcp:3:dd.500 Request processed in 43193us (224319us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760713.376270:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 165 00000100:00100000:0.0:1789760713.376279:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 317444475246 time 317446211523 state 0x2 ref 0 00000100:00100000:1.0:1789760713.384678:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760713.384782:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863122944 00000100:00100000:0.0:1789760713.384792:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863122944 00000100:00100000:0.0:1789760713.384878:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 317444475246 time 317446211523 state 0x0 ref 1 00000100:00100000:0.0:1789760713.384891:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 317646211523 time 317446211523 state 0x1 ref 1 00000100:00100000:1.0:1789760713.533181:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 317646211523 time 317646364463 state 0x0 ref 1 00000100:00100000:1.0:1789760713.533227:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d030000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863122944:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760713.533290:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b37667d5/0x3e099f5ef04ae60d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760713.533310:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760713.533314:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760713.533321:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b37667d5/0x3e099f5ef04ae60d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760713.533335:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b37667d5/0x3e099f5ef04ae60d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.551902:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b37667d5/0x3e099f5ef04ae60d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.551921:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b37667d5/0x3e099f5ef04ae60d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.551949:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b37667d5/0x3e099f5ef04ae60d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.551957:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2504caa00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760713.551961:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b37667d5/0x3e099f5ef04ae60d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.551971:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b37667d5/0x3e099f5ef04ae60d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.551991:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b37667d5/0x3e099f5ef04ae60d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.552000:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b37667d5/0x3e099f5ef04ae60d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760713.552088:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d030000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863122944:12345-192.168.203.12@tcp:3:dd.500 Request processed in 18874us (167415us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760713.552099:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 166 00000100:00100000:2.0:1789760713.552107:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 317646211523 time 317646364463 state 0x2 ref 0 00000100:00100000:3.0:1789760713.566143:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760713.566304:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863123072 00000100:00100000:2.0:1789760713.566314:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863123072 00000100:00100000:2.0:1789760713.566367:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 317646211523 time 317646364463 state 0x0 ref 1 00000100:00100000:2.0:1789760713.566380:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 317846364463 time 317646364463 state 0x1 ref 1 00000100:00100000:2.0:1789760713.733264:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 317846364463 time 317846449347 state 0x0 ref 1 00000100:00100000:2.0:1789760713.733300:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26cedfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863123072:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760713.733356:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000102e0c02/0x3e099f5ef04ae614 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.733372:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760713.733376:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760713.733383:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000102e0c02/0x3e099f5ef04ae614 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.733397:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000102e0c02/0x3e099f5ef04ae614 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.761211:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000102e0c02/0x3e099f5ef04ae614 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.761232:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000102e0c02/0x3e099f5ef04ae614 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.761242:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000102e0c02/0x3e099f5ef04ae614 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.761249:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26d28be00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760713.761265:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000102e0c02/0x3e099f5ef04ae614 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.761296:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000102e0c02/0x3e099f5ef04ae614 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.761324:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000102e0c02/0x3e099f5ef04ae614 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760713.761332:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000102e0c02/0x3e099f5ef04ae614 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760713.761430:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26cedfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863123072:12345-192.168.203.12@tcp:3:dd.500 Request processed in 28143us (195290us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760713.761441:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 167 00000100:00100000:2.0:1789760713.761449:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 317846364463 time 317846449347 state 0x2 ref 0 00000100:00100000:1.0:1789760713.783974:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760713.784069:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863123200 00000100:00100000:0.0:1789760713.784080:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863123200 00000100:00100000:0.0:1789760713.784135:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 317846364463 time 317846449347 state 0x0 ref 1 00000100:00100000:0.0:1789760713.784147:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 318046449347 time 317846449347 state 0x1 ref 1 00000100:00100000:0.0:1789760713.933526:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 318046449347 time 318046710125 state 0x0 ref 1 00000100:00100000:0.0:1789760713.933571:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863123200:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760713.933615:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae61b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.933644:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789760713.933649:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760713.933655:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae61b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.933673:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae61b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.936992:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760713.944664:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae61b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.944684:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae61b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.944693:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae61b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.944717:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760713.944722:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae61b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.944731:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae61b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.944762:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae61b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760713.944771:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae61b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760713.945291:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863123200:12345-192.168.203.12@tcp:3:dd.500 Request processed in 11731us (161331us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760713.945302:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 168 00000100:00100000:0.0:1789760713.945311:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 318046449347 time 318046710125 state 0x2 ref 0 00000100:00100000:3.0:1789760713.950918:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760713.951159:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863123328 00000100:00100000:0.0:1789760713.951169:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863123328 00000100:00100000:0.0:1789760713.951230:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 318046449347 time 318046710125 state 0x0 ref 1 00000100:00100000:0.0:1789760713.951242:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 318246710125 time 318046710125 state 0x1 ref 1 00000100:00100000:2.0:1789760714.134046:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 318246710125 time 318247231682 state 0x0 ref 1 00000100:00100000:2.0:1789760714.134084:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26cedc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863123328:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760714.134126:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000102e0c02/0x3e099f5ef04ae622 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.134145:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760714.134149:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760714.134156:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000102e0c02/0x3e099f5ef04ae622 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.134189:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000102e0c02/0x3e099f5ef04ae622 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.166144:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000102e0c02/0x3e099f5ef04ae622 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.166164:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000102e0c02/0x3e099f5ef04ae622 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.166173:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000102e0c02/0x3e099f5ef04ae622 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.166181:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26d28be00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760714.166307:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000102e0c02/0x3e099f5ef04ae622 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.166318:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000102e0c02/0x3e099f5ef04ae622 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.166338:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000102e0c02/0x3e099f5ef04ae622 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.166346:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000102e0c02/0x3e099f5ef04ae622 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760714.166458:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26cedc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863123328:12345-192.168.203.12@tcp:3:dd.500 Request processed in 32389us (215546us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760714.166468:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 169 00000100:00100000:2.0:1789760714.166475:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 318246710125 time 318247231682 state 0x2 ref 0 00000100:00100000:3.0:1789760714.179179:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760714.179493:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863123456 00000100:00100000:2.0:1789760714.179503:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863123456 00000100:00100000:2.0:1789760714.179578:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 318246710125 time 318247231682 state 0x0 ref 1 00000100:00100000:2.0:1789760714.179590:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 318447231682 time 318247231682 state 0x1 ref 1 00000100:00100000:1.0:1789760714.319096:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df257811500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883044608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760714.319180:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760714.319448:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883044608 00000100:00100000:3.0:1789760714.319456:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883044608 00000100:00100000:3.0:1789760714.319522:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789760714.319541:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d032300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883044608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760714.319576:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241893376 pending 0 free 3754950656 avail 3752853504 00000100:00100000:3.0:1789760714.319637:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d032300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883044608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760714.319645:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1789760714.319710:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760714.319859:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df257811500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883044608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760714.335933:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 318447231682 time 318449118463 state 0x0 ref 1 00000100:00100000:2.0:1789760714.335966:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df257811c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863123456:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760714.336008:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000102e0c02/0x3e099f5ef04ae629 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.336025:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760714.336031:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760714.336037:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000102e0c02/0x3e099f5ef04ae629 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.336052:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000102e0c02/0x3e099f5ef04ae629 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.345541:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000102e0c02/0x3e099f5ef04ae629 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.345573:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000102e0c02/0x3e099f5ef04ae629 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.345582:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000102e0c02/0x3e099f5ef04ae629 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.345590:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26d28be00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760714.345595:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000102e0c02/0x3e099f5ef04ae629 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.345605:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000102e0c02/0x3e099f5ef04ae629 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.345624:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000102e0c02/0x3e099f5ef04ae629 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.345633:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000102e0c02/0x3e099f5ef04ae629 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760714.345710:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df257811c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863123456:12345-192.168.203.12@tcp:3:dd.500 Request processed in 9757us (166540us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760714.345721:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 170 00000100:00100000:2.0:1789760714.345729:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 318447231682 time 318449118463 state 0x2 ref 0 00000100:00100000:3.0:1789760714.390621:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760714.390719:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863123584 00000100:00100000:0.0:1789760714.390742:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863123584 00000100:00100000:0.0:1789760714.390838:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 318447231682 time 318449118463 state 0x0 ref 1 00000100:00100000:0.0:1789760714.390851:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 318649118463 time 318449118463 state 0x1 ref 1 00000100:00100000:0.0:1789760714.536019:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 318649118463 time 318649204109 state 0x0 ref 1 00000100:00100000:0.0:1789760714.536053:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df257811180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863123584:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760714.536114:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae630 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.536132:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760714.536136:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760714.536141:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae630 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.536154:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae630 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.544700:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae630 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.544720:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae630 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.544730:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae630 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.544767:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760714.544772:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae630 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.544782:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae630 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.544836:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae630 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.544845:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae630 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760714.544940:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df257811180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863123584:12345-192.168.203.12@tcp:3:dd.500 Request processed in 8898us (154325us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760714.544950:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 171 00000100:00100000:0.0:1789760714.544958:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 318649118463 time 318649204109 state 0x2 ref 0 00000100:00100000:3.0:1789760714.551700:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760714.552041:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863123712 00000100:00100000:0.0:1789760714.552052:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863123712 00000100:00100000:0.0:1789760714.552548:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 318649118463 time 318649204109 state 0x0 ref 1 00000100:00100000:0.0:1789760714.552561:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 318849204109 time 318649204109 state 0x1 ref 1 00000100:00100000:2.0:1789760714.736252:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 318849204109 time 318849435937 state 0x0 ref 1 00000100:00100000:2.0:1789760714.736299:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df257810a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863123712:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760714.736342:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000af0e1027/0x3e099f5ef04ae637 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.736360:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760714.736365:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760714.736370:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af0e1027/0x3e099f5ef04ae637 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.736383:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af0e1027/0x3e099f5ef04ae637 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.752005:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000af0e1027/0x3e099f5ef04ae637 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.752025:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af0e1027/0x3e099f5ef04ae637 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.752034:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af0e1027/0x3e099f5ef04ae637 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.752041:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26d28bc00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760714.752046:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af0e1027/0x3e099f5ef04ae637 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.752074:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af0e1027/0x3e099f5ef04ae637 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.752094:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af0e1027/0x3e099f5ef04ae637 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760714.752102:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af0e1027/0x3e099f5ef04ae637 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760714.752186:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df257810a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863123712:12345-192.168.203.12@tcp:3:dd.500 Request processed in 15895us (200494us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760714.752197:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 172 00000100:00100000:1.0:1789760714.752205:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 318849204109 time 318849435937 state 0x2 ref 0 00000100:00100000:3.0:1789760714.759468:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760714.759566:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863123840 00000100:00100000:2.0:1789760714.759577:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863123840 00000100:00100000:2.0:1789760714.759629:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 318849204109 time 318849435937 state 0x0 ref 1 00000100:00100000:2.0:1789760714.759642:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 319049435937 time 318849435937 state 0x1 ref 1 00000100:00100000:2.0:1789760714.936426:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 319049435937 time 319049611078 state 0x0 ref 1 00000100:00100000:2.0:1789760714.936474:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df257813800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863123840:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760714.936518:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dde8909e/0x3e099f5ef04ae63e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.936546:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789760714.936551:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760714.936558:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dde8909e/0x3e099f5ef04ae63e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760714.936596:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dde8909e/0x3e099f5ef04ae63e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.958975:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760714.978722:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dde8909e/0x3e099f5ef04ae63e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.978764:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dde8909e/0x3e099f5ef04ae63e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.978773:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dde8909e/0x3e099f5ef04ae63e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.978780:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26d28a000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760714.978785:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dde8909e/0x3e099f5ef04ae63e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.978795:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dde8909e/0x3e099f5ef04ae63e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.978855:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dde8909e/0x3e099f5ef04ae63e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760714.978864:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dde8909e/0x3e099f5ef04ae63e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760714.978955:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df257813800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863123840:12345-192.168.203.12@tcp:3:dd.500 Request processed in 42505us (219491us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760714.978973:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 173 00000100:00100000:0.0:1789760714.978981:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 319049435937 time 319049611078 state 0x2 ref 0 00000100:00100000:3.0:1789760714.993062:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760714.994786:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863123968 00000100:00100000:0.0:1789760714.994829:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863123968 00000100:00100000:0.0:1789760714.994892:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 319049435937 time 319049611078 state 0x0 ref 1 00000100:00100000:0.0:1789760714.994906:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 319249611078 time 319049611078 state 0x1 ref 1 00000100:00100000:0.0:1789760715.136620:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 319249611078 time 319249805494 state 0x0 ref 1 00000100:00100000:0.0:1789760715.136669:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df257810380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863123968:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760715.136711:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae645 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.136728:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760715.136732:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760715.136738:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae645 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.136751:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae645 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789760715.142598:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789760715.153412:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae645 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.153440:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae645 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.153448:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae645 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.153471:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760715.153476:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae645 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.153485:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae645 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.153503:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae645 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.153510:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae645 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760715.153596:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df257810380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863123968:12345-192.168.203.12@tcp:3:dd.500 Request processed in 16954us (160539us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760715.153606:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 174 00000100:00100000:0.0:1789760715.153613:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 319249611078 time 319249805494 state 0x2 ref 0 00000100:00100000:3.0:1789760715.161515:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760715.167449:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863124096 00000100:00100000:0.0:1789760715.167463:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863124096 00000100:00100000:0.0:1789760715.167531:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 319249611078 time 319249805494 state 0x0 ref 1 00000100:00100000:0.0:1789760715.167554:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 319449805494 time 319249805494 state 0x1 ref 1 00000100:00100000:1.0:1789760715.339475:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 319449805494 time 319452661549 state 0x0 ref 1 00000100:00100000:1.0:1789760715.339509:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df257810e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863124096:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760715.339559:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000030714e43/0x3e099f5ef04ae64c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760715.339583:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760715.339588:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760715.339595:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030714e43/0x3e099f5ef04ae64c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760715.339638:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030714e43/0x3e099f5ef04ae64c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760715.358513:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000030714e43/0x3e099f5ef04ae64c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760715.358543:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030714e43/0x3e099f5ef04ae64c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760715.358551:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030714e43/0x3e099f5ef04ae64c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760715.358559:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df257816600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760715.358564:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030714e43/0x3e099f5ef04ae64c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760715.358572:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030714e43/0x3e099f5ef04ae64c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760715.358600:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030714e43/0x3e099f5ef04ae64c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760715.358607:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030714e43/0x3e099f5ef04ae64c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760715.358714:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df257810e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863124096:12345-192.168.203.12@tcp:3:dd.500 Request processed in 19217us (197203us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760715.358725:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 175 00000100:00100000:1.0:1789760715.358733:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 319449805494 time 319452661549 state 0x2 ref 0 00000100:00100000:2.0:1789760715.365352:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760715.365453:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863124224 00000100:00100000:0.0:1789760715.365463:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863124224 00000100:00100000:0.0:1789760715.365517:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 319449805494 time 319452661549 state 0x0 ref 1 00000100:00100000:0.0:1789760715.365550:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 319652661549 time 319452661549 state 0x1 ref 1 00000100:00100000:0.0:1789760715.539616:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 319652661549 time 319652799989 state 0x0 ref 1 00000100:00100000:0.0:1789760715.539650:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df251668a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863124224:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760715.539692:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae653 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.539711:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760715.539716:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760715.539722:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae653 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.539735:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae653 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.553156:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae653 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.553175:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae653 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.553183:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae653 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.553189:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760715.553194:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae653 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.553216:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae653 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.553234:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae653 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.553240:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae653 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760715.553318:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df251668a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863124224:12345-192.168.203.12@tcp:3:dd.500 Request processed in 13681us (187971us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760715.553328:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 176 00000100:00100000:0.0:1789760715.553335:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 319652661549 time 319652799989 state 0x2 ref 0 00000100:00100000:3.0:1789760715.562968:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760715.563120:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863124352 00000100:00100000:0.0:1789760715.563131:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863124352 00000100:00100000:0.0:1789760715.563185:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 319652661549 time 319652799989 state 0x0 ref 1 00000100:00100000:0.0:1789760715.563197:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 319852799989 time 319652799989 state 0x1 ref 1 00000100:00100000:0.0:1789760715.739882:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 319852799989 time 319853069116 state 0x0 ref 1 00000100:00100000:0.0:1789760715.739915:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df257812a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863124352:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760715.739958:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae65a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.740004:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760715.740009:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760715.740015:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae65a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.740029:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae65a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.762548:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae65a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.762582:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae65a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.762590:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae65a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.762598:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760715.762603:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae65a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.762613:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae65a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.762632:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae65a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.762660:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae65a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760715.762756:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df257812a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863124352:12345-192.168.203.12@tcp:3:dd.500 Request processed in 22850us (199801us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760715.762767:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 177 00000100:00100000:0.0:1789760715.762775:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 319852799989 time 319853069116 state 0x2 ref 0 00000100:00100000:3.0:1789760715.770756:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760715.770963:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863124480 00000100:00100000:0.0:1789760715.770979:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863124480 00000100:00100000:0.0:1789760715.771033:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 319852799989 time 319853069116 state 0x0 ref 1 00000100:00100000:0.0:1789760715.771045:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 320053069116 time 319853069116 state 0x1 ref 1 00000100:00100000:2.0:1789760715.855084:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789760715.855200:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d031500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876699883044864:0@lo:400:kworker.0 00000100:00100000:3.0:1789760715.855267:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760715.855334:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789760715.855341:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d031180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1876699883044992:0@lo:400:kworker.0 00000100:00100000:3.0:1789760715.855383:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760715.855442:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883044864 00000100:00100000:3.0:1789760715.855449:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883044864 00000100:00100000:3.0:1789760715.855487:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883044992 00000100:00100000:3.0:1789760715.855490:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883044992 00000100:00100000:3.0:1789760715.855669:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789760715.855678:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df257813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876699883044864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760715.855731:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df257813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876699883044864:12345-0@lo:400:kworker.0 Request processed in 54us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760715.855748:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789760715.855767:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789760715.855773:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df257811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876699883044992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760715.855826:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df257811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876699883044992:12345-0@lo:400:kworker.0 Request processed in 30us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760715.855832:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789760715.855868:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d031180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1876699883044992:0@lo:400:kworker.0 00000100:00100000:3.0:1789760715.855879:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d031500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876699883044864:0@lo:400:kworker.0 00000100:00080000:3.0:1789760715.855917:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760715.856121:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789760715.856133:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d030a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883045120:0@lo:400:kworker.0 00000100:00100000:0.0:1789760715.856168:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760715.856398:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883045120 00000100:00100000:3.0:1789760715.856403:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883045120 00000100:00100000:3.0:1789760715.856440:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789760715.856448:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883045120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760715.856484:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883045120:12345-0@lo:400:kworker.0 Request processed in 38us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760715.856491:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789760715.856582:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d030a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883045120:0@lo:400:kworker.0 00000100:00100000:2.0:1789760715.858755:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d031c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699883044736:0@lo:400:kworker.0 00000100:00100000:2.0:1789760715.858840:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760715.859769:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883044736 00000100:00100000:3.0:1789760715.859797:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883044736 00000100:00100000:3.0:1789760715.859884:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789760715.859895:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3308:x1876699883044736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760715.860263:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3308:x1876699883044736:12345-0@lo:400:kworker.0 Request processed in 368us (1420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760715.860271:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789760715.863242:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789760715.863266:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d030a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883045376:0@lo:400:kworker.0 00000100:00100000:1.0:1789760715.863334:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760715.863380:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883045376 00000100:00100000:1.0:1789760715.863387:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883045376 00000100:00080000:3.0:1789760715.863551:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789760715.863686:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1876699883045248:0@lo:400:kworker.0 00000100:00100000:2.0:1789760715.863721:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760715.863890:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789760715.863900:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d031500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883045376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760715.864095:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883045248 00000100:00100000:3.0:1789760715.864100:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883045248 00000100:00100000:3.0:1789760715.864134:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789760715.864141:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25166b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876699883045248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760715.864244:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d031c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699883044736:0@lo:400:kworker.0 00000100:00100000:0.0:1789760715.864292:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d030a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883045376:0@lo:400:kworker.0 00000100:00080000:2.0:1789760715.864515:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760715.867511:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d031500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883045376:12345-0@lo:400:kworker.0 Request processed in 3603us (4167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760715.867536:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789760715.868080:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25166b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876699883045248:12345-0@lo:400:kworker.0 Request processed in 3830us (4248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760715.868092:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789760715.868222:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1876699883045248:0@lo:400:kworker.0 00000100:00100000:1.0:1789760715.940100:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 320053069116 time 320053284224 state 0x0 ref 1 00000100:00100000:1.0:1789760715.940136:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df257810700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863124480:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760715.940183:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000030714e43/0x3e099f5ef04ae661 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760715.940201:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789760715.940206:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760715.940212:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030714e43/0x3e099f5ef04ae661 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760715.940254:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030714e43/0x3e099f5ef04ae661 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.963718:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000030714e43/0x3e099f5ef04ae661 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.963737:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030714e43/0x3e099f5ef04ae661 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.963761:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030714e43/0x3e099f5ef04ae661 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.963769:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df257816600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760715.963774:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030714e43/0x3e099f5ef04ae661 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.963784:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030714e43/0x3e099f5ef04ae661 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.963834:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030714e43/0x3e099f5ef04ae661 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760715.963843:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030714e43/0x3e099f5ef04ae661 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760715.963928:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df257810700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863124480:12345-192.168.203.12@tcp:3:dd.500 Request processed in 23804us (193188us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760715.963939:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 178 00000100:00100000:0.0:1789760715.963946:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 320053069116 time 320053284224 state 0x2 ref 0 00000100:00100000:1.0:1789760715.971476:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760715.971581:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863124608 00000100:00100000:0.0:1789760715.971598:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863124608 00000100:00100000:0.0:1789760715.971652:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 320053069116 time 320053284224 state 0x0 ref 1 00000100:00100000:0.0:1789760715.971665:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 320253284224 time 320053284224 state 0x1 ref 1 00010000:00010000:3.0:1789760715.983122:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760716.141119:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 320253284224 time 320254303114 state 0x0 ref 1 00000100:00100000:0.0:1789760716.141154:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d031180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863124608:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760716.141201:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae668 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.141220:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760716.141224:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760716.141230:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae668 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.141243:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae668 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.173891:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae668 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.173911:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae668 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.173920:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae668 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.173928:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760716.173932:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae668 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.173981:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae668 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.174010:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae668 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.174026:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae668 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760716.174126:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d031180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863124608:12345-192.168.203.12@tcp:3:dd.500 Request processed in 32985us (202655us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760716.174137:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 179 00000100:00100000:0.0:1789760716.174145:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 320253284224 time 320254303114 state 0x2 ref 0 00000100:00100000:1.0:1789760716.185419:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760716.185513:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863124736 00000100:00100000:0.0:1789760716.185533:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863124736 00000100:00100000:0.0:1789760716.185592:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 320253284224 time 320254303114 state 0x0 ref 1 00000100:00100000:0.0:1789760716.185613:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 320454303114 time 320254303114 state 0x1 ref 1 00000100:00100000:0.0:1789760716.341277:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 320454303114 time 320454461180 state 0x0 ref 1 00000100:00100000:0.0:1789760716.341315:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863124736:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760716.341359:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae66f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.341397:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760716.341401:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760716.341407:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae66f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.341420:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae66f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.366330:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae66f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.366352:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae66f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.366361:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae66f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.366368:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760716.366373:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae66f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.366382:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae66f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.366403:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae66f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.366431:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae66f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760716.366526:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863124736:12345-192.168.203.12@tcp:3:dd.500 Request processed in 25215us (181105us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760716.366536:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 180 00000100:00100000:0.0:1789760716.366545:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 320454303114 time 320454461180 state 0x2 ref 0 00000100:00100000:0.0:1789760716.367010:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883045504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760716.367058:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760716.367131:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883045504 00000100:00100000:0.0:1789760716.367138:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883045504 00000100:00100000:0.0:1789760716.367173:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789760716.367182:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883045504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789760716.367215:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760716.367253:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883045504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760716.367260:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789760716.367300:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258e38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883045504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760716.376536:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760716.386078:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863124864 00000100:00100000:0.0:1789760716.386096:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863124864 00000100:00100000:0.0:1789760716.386156:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 320454303114 time 320454461180 state 0x0 ref 1 00000100:00100000:0.0:1789760716.386170:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 320654461180 time 320454461180 state 0x1 ref 1 00000100:00100000:0.0:1789760716.541396:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 320654461180 time 320654581544 state 0x0 ref 1 00000100:00100000:0.0:1789760716.541443:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df257812680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863124864:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760716.541499:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae676 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.541532:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760716.541537:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760716.541543:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae676 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.541565:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae676 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.570773:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae676 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.570793:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae676 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.570832:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae676 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.570840:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760716.570845:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae676 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.570855:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae676 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.570889:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae676 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.570896:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae676 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760716.570983:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df257812680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863124864:12345-192.168.203.12@tcp:3:dd.500 Request processed in 29548us (194460us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760716.570993:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 181 00000100:00100000:0.0:1789760716.571000:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 320654461180 time 320654581544 state 0x2 ref 0 00000100:00100000:1.0:1789760716.579910:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760716.580076:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863124992 00000100:00100000:0.0:1789760716.580086:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863124992 00000100:00100000:0.0:1789760716.580138:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 320654461180 time 320654581544 state 0x0 ref 1 00000100:00100000:0.0:1789760716.580150:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 320854581544 time 320654581544 state 0x1 ref 1 00000100:00100000:0.0:1789760716.741564:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 320854581544 time 320854741664 state 0x0 ref 1 00000100:00100000:0.0:1789760716.741600:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d031f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863124992:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760716.741645:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae67d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.741663:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760716.741668:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760716.741674:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae67d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.741710:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae67d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.759876:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae67d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.759898:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae67d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.759908:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae67d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.759916:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760716.759921:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae67d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.759932:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae67d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.759969:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae67d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.759977:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae67d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760716.760083:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d031f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863124992:12345-192.168.203.12@tcp:3:dd.500 Request processed in 18494us (180174us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760716.760094:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 182 00000100:00100000:0.0:1789760716.760102:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 320854581544 time 320854741664 state 0x2 ref 0 00000100:00100000:3.0:1789760716.764478:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760716.764866:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863125120 00000100:00100000:0.0:1789760716.764877:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863125120 00000100:00100000:0.0:1789760716.764929:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 320854581544 time 320854741664 state 0x0 ref 1 00000100:00100000:0.0:1789760716.764942:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 321054741664 time 320854741664 state 0x1 ref 1 00000100:00100000:0.0:1789760716.941794:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 321054741664 time 321054978643 state 0x0 ref 1 00000100:00100000:0.0:1789760716.941851:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df257811880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863125120:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760716.941894:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae684 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.941910:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789760716.941914:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760716.941919:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae684 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760716.941935:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae684 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760717.008952:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760717.010253:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae684 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760717.010271:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae684 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760717.010280:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae684 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760717.010287:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760717.010291:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae684 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760717.010301:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae684 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760717.010319:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae684 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760717.010326:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae684 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760717.010419:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df257811880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863125120:12345-192.168.203.12@tcp:3:dd.500 Request processed in 68576us (245946us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760717.010429:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 183 00000100:00100000:0.0:1789760717.010438:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 321054741664 time 321054978643 state 0x2 ref 0 00000100:00100000:0.0:1789760717.022264:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760717.025835:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863125248 00000100:00100000:2.0:1789760717.025850:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863125248 00000100:00100000:2.0:1789760717.026003:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 321054741664 time 321054978643 state 0x0 ref 1 00000100:00100000:2.0:1789760717.026017:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 321254978643 time 321054978643 state 0x1 ref 1 00000100:00080000:3.0:1789760717.029971:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760717.142169:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 321254978643 time 321255353887 state 0x0 ref 1 00000100:00100000:0.0:1789760717.142202:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863125248:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760717.142247:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae68b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760717.142277:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760717.142283:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760717.142290:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae68b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760717.142304:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae68b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760717.160892:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae68b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760717.160912:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae68b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760717.160922:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae68b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760717.160931:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760717.160935:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae68b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760717.160949:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae68b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760717.160968:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae68b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760717.160976:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009893b0c0/0x3e099f5ef04ae68b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760717.161085:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863125248:12345-192.168.203.12@tcp:3:dd.500 Request processed in 18895us (138825us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760717.161095:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 184 00000100:00100000:1.0:1789760717.161103:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 321254978643 time 321255353887 state 0x2 ref 0 00000100:00100000:0.0:1789760717.167907:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760717.168077:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863125376 00000100:00100000:2.0:1789760717.168089:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863125376 00000100:00100000:2.0:1789760717.168146:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 321254978643 time 321255353887 state 0x0 ref 1 00000100:00100000:2.0:1789760717.168161:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 321455353887 time 321255353887 state 0x1 ref 1 00000100:00100000:0.0:1789760717.342334:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 321455353887 time 321455516610 state 0x0 ref 1 00000100:00100000:0.0:1789760717.342371:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863125376:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760717.342417:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae692 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760717.342434:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760717.342439:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760717.342446:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae692 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760717.342459:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae692 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760717.356302:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae692 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760717.356340:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae692 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760717.356348:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae692 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760717.356354:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f077600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760717.356358:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae692 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760717.356366:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae692 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760717.356384:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae692 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760717.356390:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088c40d55/0x3e099f5ef04ae692 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760717.356493:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863125376:12345-192.168.203.12@tcp:3:dd.500 Request processed in 14137us (188593us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760717.356503:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 185 00000100:00100000:2.0:1789760717.356519:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 321455353887 time 321455516610 state 0x2 ref 0 00000100:00100000:3.0:1789760717.371066:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760717.371169:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863125504 00000100:00100000:0.0:1789760717.371179:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863125504 00000100:00100000:0.0:1789760717.371234:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 321455353887 time 321455516610 state 0x0 ref 1 00000100:00100000:0.0:1789760717.371246:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 321655516610 time 321455516610 state 0x1 ref 1 00000100:00100000:0.0:1789760717.543420:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 321655516610 time 321656605733 state 0x0 ref 1 00000100:00100000:0.0:1789760717.543455:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df257812d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863125504:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760717.543498:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008e88fa1c/0x3e099f5ef04ae699 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760717.543526:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760717.543531:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760717.543538:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e88fa1c/0x3e099f5ef04ae699 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760717.543551:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e88fa1c/0x3e099f5ef04ae699 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760717.579115:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008e88fa1c/0x3e099f5ef04ae699 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760717.579136:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e88fa1c/0x3e099f5ef04ae699 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760717.579145:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e88fa1c/0x3e099f5ef04ae699 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760717.579153:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f077800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760717.579158:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e88fa1c/0x3e099f5ef04ae699 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760717.579168:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e88fa1c/0x3e099f5ef04ae699 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760717.579187:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e88fa1c/0x3e099f5ef04ae699 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760717.579195:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e88fa1c/0x3e099f5ef04ae699 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760717.579310:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df257812d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863125504:12345-192.168.203.12@tcp:3:dd.500 Request processed in 35867us (208249us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760717.579322:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 186 00000100:00100000:1.0:1789760717.579330:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 321655516610 time 321656605733 state 0x2 ref 0 00000100:00100000:3.0:1789760717.590738:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760717.590858:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863125632 00000100:00100000:2.0:1789760717.590882:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863125632 00000100:00100000:2.0:1789760717.590948:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 321655516610 time 321656605733 state 0x0 ref 1 00000100:00100000:2.0:1789760717.590960:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 321856605733 time 321656605733 state 0x1 ref 1 00000100:00100000:1.0:1789760717.743687:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 321856605733 time 321856873529 state 0x0 ref 1 00000100:00100000:1.0:1789760717.743732:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df257810000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863125632:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760717.743773:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6a0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760717.743789:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760717.743793:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760717.743819:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760717.743834:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760717.768466:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760717.768485:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760717.768523:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760717.768530:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df259687600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760717.768535:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760717.768544:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760717.768565:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760717.768573:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760717.769016:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df257810000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863125632:12345-192.168.203.12@tcp:3:dd.500 Request processed in 25305us (178281us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760717.769027:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 187 00000100:00100000:1.0:1789760717.769035:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 321856605733 time 321856873529 state 0x2 ref 0 00000100:00100000:2.0:1789760717.789110:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760717.791464:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863125760 00000100:00100000:0.0:1789760717.791480:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863125760 00000100:00100000:0.0:1789760717.791554:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 321856605733 time 321856873529 state 0x0 ref 1 00000100:00100000:0.0:1789760717.791569:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 322056873529 time 321856873529 state 0x1 ref 1 00000100:00100000:2.0:1789760717.955057:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 322056873529 time 322068242762 state 0x0 ref 1 00000100:00100000:2.0:1789760717.955091:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df251668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863125760:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760717.955134:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ae694a10/0x3e099f5ef04ae6a7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760717.955153:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789760717.955158:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760717.955164:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae694a10/0x3e099f5ef04ae6a7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760717.955181:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae694a10/0x3e099f5ef04ae6a7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760717.984971:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ae694a10/0x3e099f5ef04ae6a7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760717.985003:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae694a10/0x3e099f5ef04ae6a7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760717.985032:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae694a10/0x3e099f5ef04ae6a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760717.985039:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df277db6200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760717.985044:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae694a10/0x3e099f5ef04ae6a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760717.985053:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae694a10/0x3e099f5ef04ae6a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760717.985073:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae694a10/0x3e099f5ef04ae6a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760717.985081:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae694a10/0x3e099f5ef04ae6a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760717.985188:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df251668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863125760:12345-192.168.203.12@tcp:3:dd.500 Request processed in 30108us (196083us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760717.985199:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 188 00000100:00100000:1.0:1789760717.985207:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 322056873529 time 322068242762 state 0x2 ref 0 00000100:00100000:2.0:1789760717.992089:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760717.992250:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863125888 00000100:00100000:0.0:1789760717.992274:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863125888 00000100:00100000:0.0:1789760717.992330:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 322056873529 time 322068242762 state 0x0 ref 1 00000100:00100000:0.0:1789760717.992343:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 322268242762 time 322068242762 state 0x1 ref 1 00010000:00010000:0.0:1789760718.031088:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760718.155312:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 322268242762 time 322268497199 state 0x0 ref 1 00000100:00100000:1.0:1789760718.155348:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df251668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863125888:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760718.155393:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6ae lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.155440:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760718.155445:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760718.155451:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.155465:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.177792:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.177835:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.177846:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.177854:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df259687600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760718.177858:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.177867:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.177887:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.177914:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760718.178156:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df251668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863125888:12345-192.168.203.12@tcp:3:dd.500 Request processed in 22821us (186072us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760718.178167:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 189 00000100:00100000:1.0:1789760718.178338:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 322268242762 time 322268497199 state 0x2 ref 0 00000100:00100000:2.0:1789760718.184144:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760718.184249:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863126016 00000100:00100000:0.0:1789760718.184259:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863126016 00000100:00100000:0.0:1789760718.184314:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 322268242762 time 322268497199 state 0x0 ref 1 00000100:00100000:0.0:1789760718.184326:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 322468497199 time 322268497199 state 0x1 ref 1 00000100:00100000:1.0:1789760718.355464:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 322468497199 time 322468649502 state 0x0 ref 1 00000100:00100000:1.0:1789760718.355497:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25166aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863126016:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760718.355549:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6b5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.355634:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760718.355639:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760718.355646:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6b5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.355661:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6b5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.376249:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6b5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.376288:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.376298:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.376306:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df259687600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760718.376311:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.376321:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.376341:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.376349:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760718.376430:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25166aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863126016:12345-192.168.203.12@tcp:3:dd.500 Request processed in 20945us (192290us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760718.376441:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 190 00000100:00100000:1.0:1789760718.376449:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 322468497199 time 322468649502 state 0x2 ref 0 00000100:00100000:2.0:1789760718.383580:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760718.383746:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863126144 00000100:00100000:0.0:1789760718.383757:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863126144 00000100:00100000:0.0:1789760718.383836:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 322468497199 time 322468649502 state 0x0 ref 1 00000100:00100000:0.0:1789760718.383849:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 322668649502 time 322468649502 state 0x1 ref 1 00000100:00100000:0.0:1789760718.451002:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760718.451054:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760718.451087:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760718.451231:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863126272 00000100:00100000:3.0:1789760718.451241:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863126272 00000100:00100000:3.0:1789760718.451302:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 265 00000100:00100000:3.0:1789760718.451312:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2349:x1876699863126272:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760718.451392:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2349:x1876699863126272:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 80us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760718.451400:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 265 00000100:00100000:1.0:1789760718.451835:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863126400 00000100:00100000:1.0:1789760718.451848:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863126400 00000100:00100000:1.0:1789760718.451886:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863126528 00000100:00100000:1.0:1789760718.451890:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863126528 00000100:00100000:1.0:1789760718.451915:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 134 00000100:00100000:1.0:1789760718.451923:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+9:2349:x1876699863126400:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1789760718.451971:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+9:2349:x1876699863126400:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 49us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760718.451990:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 134 00000100:00100000:1.0:1789760718.452005:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 135 00000100:00100000:1.0:1789760718.452012:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2349:x1876699863126528:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1789760718.452035:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2349:x1876699863126528:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760718.452042:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 135 00000100:00080000:3.0:1789760718.452293:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760718.555761:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 322668649502 time 322668944423 state 0x0 ref 1 00000100:00100000:1.0:1789760718.555835:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df251668700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863126144:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760718.555889:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6bc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.555906:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760718.555910:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760718.555917:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6bc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.555943:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6bc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.574699:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6bc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.574729:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6bc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.574738:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.574746:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df259687600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760718.574751:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.574760:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.574779:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.574786:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760718.574911:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df251668700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863126144:12345-192.168.203.12@tcp:3:dd.500 Request processed in 19126us (191334us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760718.574923:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 191 00000100:00100000:1.0:1789760718.574946:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 322668649502 time 322668944423 state 0x2 ref 0 00000100:00100000:3.0:1789760718.589493:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760718.604187:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863126656 00000100:00100000:1.0:1789760718.604203:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863126656 00000100:00100000:1.0:1789760718.604279:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 322668649502 time 322668944423 state 0x0 ref 1 00000100:00100000:1.0:1789760718.604292:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 322868944423 time 322668944423 state 0x1 ref 1 00000100:00100000:1.0:1789760718.755879:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 322868944423 time 322869064733 state 0x0 ref 1 00000100:00100000:1.0:1789760718.755914:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df257813100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863126656:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760718.755958:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6c3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.755975:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760718.755980:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760718.755986:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.756001:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.775839:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.775861:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6c3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.775870:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.775891:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df259687600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760718.775896:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.775905:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.775923:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6c3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.775936:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760718.776091:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df257813100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863126656:12345-192.168.203.12@tcp:3:dd.500 Request processed in 20188us (186603us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760718.776103:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 192 00000100:00100000:1.0:1789760718.776111:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 322868944423 time 322869064733 state 0x2 ref 0 00000100:00100000:0.0:1789760718.782569:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760718.783214:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863126784 00000100:00100000:2.0:1789760718.783224:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863126784 00000100:00100000:2.0:1789760718.783273:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 322868944423 time 322869064733 state 0x0 ref 1 00000100:00100000:2.0:1789760718.783285:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 323069064733 time 322869064733 state 0x1 ref 1 00000100:00100000:1.0:1789760718.956105:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 323069064733 time 323069288279 state 0x0 ref 1 00000100:00100000:1.0:1789760718.956140:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863126784:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760718.956184:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6ca lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.956202:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789760718.956223:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760718.956230:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6ca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.956247:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6ca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.989910:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6ca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.989941:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.989949:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.989957:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df259687600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760718.989961:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.989970:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.990111:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760718.990118:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760718.990231:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863126784:12345-192.168.203.12@tcp:3:dd.500 Request processed in 34105us (207669us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760718.990242:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 193 00000100:00100000:1.0:1789760718.990250:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 323069064733 time 323069288279 state 0x2 ref 0 00000100:00100000:0.0:1789760718.995228:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760718.995309:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863126912 00000100:00100000:1.0:1789760718.995320:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863126912 00000100:00100000:1.0:1789760718.995375:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 323069064733 time 323069288279 state 0x0 ref 1 00000100:00100000:1.0:1789760718.995387:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 323269288279 time 323069288279 state 0x1 ref 1 00010000:00010000:3.0:1789760719.055378:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760719.156309:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 323269288279 time 323269485410 state 0x0 ref 1 00000100:00100000:1.0:1789760719.156365:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863126912:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760719.156408:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6d1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.156425:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760719.156429:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760719.156435:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.156448:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789760719.157314:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789760719.177282:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.177329:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6d1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.177338:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.177346:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df259687600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760719.177351:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.177360:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.177381:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6d1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.177390:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6d1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760719.177485:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863126912:12345-192.168.203.12@tcp:3:dd.500 Request processed in 21153us (182262us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760719.177507:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 194 00000100:00100000:1.0:1789760719.177516:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 323269288279 time 323269485410 state 0x2 ref 0 00000100:00100000:3.0:1789760719.184977:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760719.185128:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863127040 00000100:00100000:1.0:1789760719.185150:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863127040 00000100:00100000:1.0:1789760719.185204:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 323269288279 time 323269485410 state 0x0 ref 1 00000100:00100000:1.0:1789760719.185217:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 323469485410 time 323269485410 state 0x1 ref 1 00000100:00100000:1.0:1789760719.356421:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 323469485410 time 323469606159 state 0x0 ref 1 00000100:00100000:1.0:1789760719.356456:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df257813b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863127040:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760719.356517:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6d8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.356535:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760719.356539:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760719.356546:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.356560:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.379933:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.379955:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6d8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.379965:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.379993:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df259687600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760719.379998:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.380006:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.380026:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6d8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.380034:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760719.380371:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df257813b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863127040:12345-192.168.203.12@tcp:3:dd.500 Request processed in 23928us (195397us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760719.380382:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 195 00000100:00100000:1.0:1789760719.380390:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 323469485410 time 323469606159 state 0x2 ref 0 00000100:00100000:3.0:1789760719.385692:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760719.387276:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863127168 00000100:00100000:1.0:1789760719.387289:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863127168 00000100:00100000:1.0:1789760719.387348:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 323469485410 time 323469606159 state 0x0 ref 1 00000100:00100000:1.0:1789760719.387361:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 323669606159 time 323469606159 state 0x1 ref 1 00000100:00100000:0.0:1789760719.439346:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df257811500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883045632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789760719.439418:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760719.439688:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883045632 00000100:00100000:3.0:1789760719.439696:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883045632 00000100:00100000:3.0:1789760719.439843:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789760719.439853:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883045632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760719.439888:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241893376 pending 0 free 3754950656 avail 3752853504 00000100:00100000:3.0:1789760719.439948:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883045632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760719.439956:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789760719.440031:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df257811500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883045632:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789760719.440162:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760719.556543:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 323669606159 time 323669728389 state 0x0 ref 1 00000100:00100000:1.0:1789760719.556580:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df257812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863127168:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760719.556635:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6df lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.556653:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760719.556658:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760719.556664:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6df lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.556678:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6df lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.584416:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6df lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.584437:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6df lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.584446:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.584454:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df259687600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760719.584459:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.584468:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.584520:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.584529:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760719.584661:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df257812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863127168:12345-192.168.203.12@tcp:3:dd.500 Request processed in 28094us (198974us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760719.584673:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 196 00000100:00100000:1.0:1789760719.584681:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 323669606159 time 323669728389 state 0x2 ref 0 00000100:00100000:1.0:1789760719.591610:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760719.591705:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863127296 00000100:00100000:0.0:1789760719.591778:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863127296 00000100:00100000:0.0:1789760719.592004:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 323669606159 time 323669728389 state 0x0 ref 1 00000100:00100000:0.0:1789760719.592017:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 323869728389 time 323669728389 state 0x1 ref 1 00000100:00100000:1.0:1789760719.756856:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 323869728389 time 323870040538 state 0x0 ref 1 00000100:00100000:1.0:1789760719.756905:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d032680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863127296:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760719.757138:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6e6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.757156:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760719.757161:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760719.757167:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.757183:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.769499:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.769520:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6e6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.769529:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.769536:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df259687600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760719.769551:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.769561:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.769598:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760719.769605:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099909b5d/0x3e099f5ef04ae6e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760719.769695:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d032680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863127296:12345-192.168.203.12@tcp:3:dd.500 Request processed in 12806us (178089us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760719.769705:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 197 00000100:00100000:3.0:1789760719.769721:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 323869728389 time 323870040538 state 0x2 ref 0 00000100:00100000:1.0:1789760719.784697:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760719.784822:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863127424 00000100:00100000:0.0:1789760719.784830:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863127424 00000100:00100000:0.0:1789760719.784886:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 323869728389 time 323870040538 state 0x0 ref 1 00000100:00100000:0.0:1789760719.784896:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 324070040538 time 323870040538 state 0x1 ref 1 00000100:00100000:1.0:1789760719.957449:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 324070040538 time 324070635194 state 0x0 ref 1 00000100:00100000:1.0:1789760719.957482:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d031880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863127424:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760719.957533:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fc910787/0x3e099f5ef04ae6ed lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.957550:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789760719.957554:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760719.957560:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc910787/0x3e099f5ef04ae6ed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760719.957576:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc910787/0x3e099f5ef04ae6ed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.986273:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fc910787/0x3e099f5ef04ae6ed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.986293:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc910787/0x3e099f5ef04ae6ed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.986303:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc910787/0x3e099f5ef04ae6ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.986311:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df259687000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760719.986315:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc910787/0x3e099f5ef04ae6ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.986325:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc910787/0x3e099f5ef04ae6ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.986343:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc910787/0x3e099f5ef04ae6ed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760719.986352:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc910787/0x3e099f5ef04ae6ed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760719.986438:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d031880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863127424:12345-192.168.203.12@tcp:3:dd.500 Request processed in 28968us (201745us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760719.986449:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 198 00000100:00100000:2.0:1789760719.986456:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 324070040538 time 324070635194 state 0x2 ref 0 00000100:00100000:0.0:1789760719.997485:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760719.997603:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863127552 00000100:00100000:1.0:1789760719.997613:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863127552 00000100:00100000:1.0:1789760719.997668:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 324070040538 time 324070635194 state 0x0 ref 1 00000100:00100000:1.0:1789760719.997680:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 324270635194 time 324070635194 state 0x1 ref 1 00010000:00010000:0.0:1789760720.079859:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760720.158641:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 324270635194 time 324271827265 state 0x0 ref 1 00000100:00100000:1.0:1789760720.158676:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863127552:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760720.158724:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006aaebca0/0x3e099f5ef04ae6f4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.158757:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760720.158762:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760720.158768:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aaebca0/0x3e099f5ef04ae6f4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.158783:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006aaebca0/0x3e099f5ef04ae6f4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.174352:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006aaebca0/0x3e099f5ef04ae6f4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.174374:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006aaebca0/0x3e099f5ef04ae6f4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.174383:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006aaebca0/0x3e099f5ef04ae6f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.174391:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df259687e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760720.174397:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006aaebca0/0x3e099f5ef04ae6f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.174406:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006aaebca0/0x3e099f5ef04ae6f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.174425:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006aaebca0/0x3e099f5ef04ae6f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.174453:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006aaebca0/0x3e099f5ef04ae6f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760720.174888:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863127552:12345-192.168.203.12@tcp:3:dd.500 Request processed in 16223us (177405us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760720.174900:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 199 00000100:00100000:1.0:1789760720.174907:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 324270635194 time 324271827265 state 0x2 ref 0 00000100:00100000:1.0:1789760720.184992:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760720.185140:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863127680 00000100:00100000:2.0:1789760720.185150:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863127680 00000100:00100000:2.0:1789760720.185207:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 324270635194 time 324271827265 state 0x0 ref 1 00000100:00100000:2.0:1789760720.185220:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 324471827265 time 324271827265 state 0x1 ref 1 00000100:00100000:3.0:1789760720.359366:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 324471827265 time 324472549755 state 0x0 ref 1 00000100:00100000:3.0:1789760720.359401:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863127680:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:3.0:1789760720.359442:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c12290ce/0x3e099f5ef04ae6fb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.359459:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760720.359463:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760720.359468:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c12290ce/0x3e099f5ef04ae6fb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.359482:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c12290ce/0x3e099f5ef04ae6fb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.382542:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c12290ce/0x3e099f5ef04ae6fb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.382563:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c12290ce/0x3e099f5ef04ae6fb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.382571:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c12290ce/0x3e099f5ef04ae6fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.382579:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df274b35000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760720.382583:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c12290ce/0x3e099f5ef04ae6fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.382593:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c12290ce/0x3e099f5ef04ae6fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.382613:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c12290ce/0x3e099f5ef04ae6fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.382621:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c12290ce/0x3e099f5ef04ae6fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760720.382717:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863127680:12345-192.168.203.12@tcp:3:dd.500 Request processed in 23324us (197728us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760720.382729:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 200 00000100:00100000:3.0:1789760720.382753:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 324471827265 time 324472549755 state 0x2 ref 0 00000100:00100000:3.0:1789760720.390748:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760720.390851:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863127808 00000100:00100000:0.0:1789760720.390861:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863127808 00000100:00100000:0.0:1789760720.390929:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 324471827265 time 324472549755 state 0x0 ref 1 00000100:00100000:0.0:1789760720.390942:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 324672549755 time 324472549755 state 0x1 ref 1 00000100:00100000:2.0:1789760720.559588:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 324672549755 time 324672773608 state 0x0 ref 1 00000100:00100000:2.0:1789760720.559622:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df257811500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863127808:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760720.559665:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007b6f9f13/0x3e099f5ef04ae702 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760720.559683:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760720.559688:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760720.559694:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b6f9f13/0x3e099f5ef04ae702 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760720.559717:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b6f9f13/0x3e099f5ef04ae702 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760720.590766:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007b6f9f13/0x3e099f5ef04ae702 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760720.590786:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b6f9f13/0x3e099f5ef04ae702 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760720.590795:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b6f9f13/0x3e099f5ef04ae702 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760720.590873:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26d708600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760720.590878:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b6f9f13/0x3e099f5ef04ae702 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760720.590892:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b6f9f13/0x3e099f5ef04ae702 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760720.590919:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b6f9f13/0x3e099f5ef04ae702 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760720.590930:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b6f9f13/0x3e099f5ef04ae702 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760720.592086:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df257811500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863127808:12345-192.168.203.12@tcp:3:dd.500 Request processed in 32472us (201341us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760720.592099:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 201 00000100:00100000:2.0:1789760720.592107:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 324672549755 time 324672773608 state 0x2 ref 0 00000100:00100000:3.0:1789760720.601300:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760720.601397:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863127936 00000100:00100000:1.0:1789760720.601406:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863127936 00000100:00100000:1.0:1789760720.601456:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 324672549755 time 324672773608 state 0x0 ref 1 00000100:00100000:1.0:1789760720.601468:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 324872773608 time 324672773608 state 0x1 ref 1 00000100:00100000:1.0:1789760720.760440:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 324872773608 time 324873626176 state 0x0 ref 1 00000100:00100000:1.0:1789760720.760476:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863127936:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760720.760529:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae709 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.760546:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760720.760551:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760720.760557:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae709 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.760570:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae709 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.780467:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae709 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.780512:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae709 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.780521:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae709 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.780528:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760720.780533:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae709 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.780542:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae709 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.780560:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae709 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.780568:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae709 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760720.780647:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863127936:12345-192.168.203.12@tcp:3:dd.500 Request processed in 20185us (179352us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760720.780657:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 202 00000100:00100000:1.0:1789760720.780678:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 324872773608 time 324873626176 state 0x2 ref 0 00000100:00100000:3.0:1789760720.787603:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760720.787708:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863128064 00000100:00100000:2.0:1789760720.787719:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863128064 00000100:00100000:2.0:1789760720.787773:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 324872773608 time 324873626176 state 0x0 ref 1 00000100:00100000:2.0:1789760720.787786:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 325073626176 time 324873626176 state 0x1 ref 1 00000100:00100000:3.0:1789760720.962878:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 325073626176 time 325076061035 state 0x0 ref 1 00000100:00100000:3.0:1789760720.962925:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d1ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863128064:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:3.0:1789760720.962968:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000063d95c20/0x3e099f5ef04ae710 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.962984:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789760720.962989:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760720.962995:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063d95c20/0x3e099f5ef04ae710 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760720.963011:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063d95c20/0x3e099f5ef04ae710 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760720.975088:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d030a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876699883045888:0@lo:400:kworker.0 00000100:00100000:1.0:1789760720.975155:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760720.975222:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27218b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883046400:0@lo:400:kworker.0 00000100:00100000:1.0:1789760720.975245:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760720.975276:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789760720.975281:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d031c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1876699883046016:0@lo:400:kworker.0 00000100:00100000:1.0:1789760720.975302:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760720.975335:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883045888 00000100:00100000:1.0:1789760720.975344:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883045888 00000100:00100000:1.0:1789760720.975388:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883046016 00000100:00100000:1.0:1789760720.975392:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883046016 00000100:00100000:1.0:1789760720.975422:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789760720.975430:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27218bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876699883045888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760720.975495:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27218bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876699883045888:12345-0@lo:400:kworker.0 Request processed in 50us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760720.975503:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789760720.975523:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789760720.975529:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df272189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876699883046016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760720.975560:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df272189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876699883046016:12345-0@lo:400:kworker.0 Request processed in 32us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760720.975566:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789760720.975585:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883046400 00000100:00100000:1.0:1789760720.975589:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883046400 00000100:00100000:1.0:1789760720.975620:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789760720.975628:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27218a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883046400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760720.975675:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27218a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883046400:12345-0@lo:400:kworker.0 Request processed in 47us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760720.975683:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789760720.975723:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d031c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1876699883046016:0@lo:400:kworker.0 00000100:00100000:1.0:1789760720.975732:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d030a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876699883045888:0@lo:400:kworker.0 00000100:00100000:1.0:1789760720.975739:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27218b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883046400:0@lo:400:kworker.0 00000100:00100000:0.0:1789760720.976012:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27218ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883046144:0@lo:400:kworker.0 00000100:00100000:0.0:1789760720.976043:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760720.976071:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789760720.976078:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699883045760:0@lo:400:kworker.0 00000100:00100000:0.0:1789760720.976104:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760720.976128:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df272188000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1876699883046272:0@lo:400:kworker.0 00000100:00100000:0.0:1789760720.976150:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760720.976171:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883045760 00000100:00100000:0.0:1789760720.976175:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883045760 00000100:00100000:0.0:1789760720.976202:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789760720.976208:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2478c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3308:x1876699883045760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760720.976241:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2478c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3308:x1876699883045760:12345-0@lo:400:kworker.0 Request processed in 33us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760720.976248:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789760720.976293:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699883045760:0@lo:400:kworker.0 00000100:00100000:1.0:1789760720.976363:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883046144 00000100:00100000:1.0:1789760720.976367:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883046144 00000100:00100000:1.0:1789760720.976401:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789760720.976409:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883046144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760720.976455:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883046144:12345-0@lo:400:kworker.0 Request processed in 48us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760720.976462:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789760720.976489:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883046272 00000100:00100000:1.0:1789760720.976492:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883046272 00000100:00100000:1.0:1789760720.976517:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789760720.976524:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876699883046272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760720.976556:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876699883046272:12345-0@lo:400:kworker.0 Request processed in 33us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760720.976561:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:2.0:1789760720.976871:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789760720.976877:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760720.979796:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df272188000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1876699883046272:0@lo:400:kworker.0 00000100:00100000:3.0:1789760720.979856:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27218ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883046144:0@lo:400:kworker.0 00010000:00010000:1.0:1789760720.988439:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000063d95c20/0x3e099f5ef04ae710 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.988461:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063d95c20/0x3e099f5ef04ae710 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.988499:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063d95c20/0x3e099f5ef04ae710 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.988506:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df274b34e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760720.988511:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d95c20/0x3e099f5ef04ae710 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.988520:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d95c20/0x3e099f5ef04ae710 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.988539:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063d95c20/0x3e099f5ef04ae710 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760720.988548:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063d95c20/0x3e099f5ef04ae710 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760720.988639:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d1ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863128064:12345-192.168.203.12@tcp:3:dd.500 Request processed in 25737us (201039us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760720.988649:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 203 00000100:00100000:1.0:1789760720.988656:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 325073626176 time 325076061035 state 0x2 ref 0 00000100:00100000:3.0:1789760721.002452:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760721.002682:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863128192 00000100:00100000:0.0:1789760721.002693:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863128192 00000100:00100000:0.0:1789760721.002769:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 325073626176 time 325076061035 state 0x0 ref 1 00000100:00100000:0.0:1789760721.002782:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 325276061035 time 325076061035 state 0x1 ref 1 00000100:00080000:2.0:1789760721.002926:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789760721.109517:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760721.163039:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 325276061035 time 325276224513 state 0x0 ref 1 00000100:00100000:2.0:1789760721.163075:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863128192:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760721.163115:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04ae717 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.163132:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760721.163136:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760721.163142:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04ae717 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.163156:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04ae717 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.173874:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04ae717 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.173894:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04ae717 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.173903:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04ae717 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.173910:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241538e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760721.173915:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04ae717 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.173944:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04ae717 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.174040:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04ae717 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.174050:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04ae717 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760721.174141:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863128192:12345-192.168.203.12@tcp:3:dd.500 Request processed in 11079us (171694us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760721.174152:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 204 00000100:00100000:2.0:1789760721.174161:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 325276061035 time 325276224513 state 0x2 ref 0 00000100:00100000:0.0:1789760721.183592:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760721.183713:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863128320 00000100:00100000:1.0:1789760721.183723:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863128320 00000100:00100000:1.0:1789760721.183779:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 325276061035 time 325276224513 state 0x0 ref 1 00000100:00100000:1.0:1789760721.183794:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 325476224513 time 325276224513 state 0x1 ref 1 00000100:00100000:1.0:1789760721.363132:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 325476224513 time 325476318075 state 0x0 ref 1 00000100:00100000:1.0:1789760721.363166:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863128320:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760721.363211:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae71e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.363229:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760721.363234:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760721.363249:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae71e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.363264:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae71e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.380181:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae71e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.380200:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae71e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.380209:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae71e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.380216:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760721.380220:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae71e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.380258:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae71e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.380277:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae71e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.380285:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae71e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760721.383612:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863128320:12345-192.168.203.12@tcp:3:dd.500 Request processed in 20449us (200017us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760721.383628:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 205 00000100:00100000:1.0:1789760721.383636:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 325476224513 time 325476318075 state 0x2 ref 0 00000100:00100000:0.0:1789760721.398411:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760721.404168:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863128448 00000100:00100000:2.0:1789760721.404185:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863128448 00000100:00100000:2.0:1789760721.404245:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 325476224513 time 325476318075 state 0x0 ref 1 00000100:00100000:2.0:1789760721.404258:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 325676318075 time 325476318075 state 0x1 ref 1 00000100:00100000:1.0:1789760721.487231:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2517f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883046528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760721.487307:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760721.487641:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883046528 00000100:00100000:3.0:1789760721.487658:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883046528 00000100:00100000:3.0:1789760721.488041:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789760721.488052:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27218b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883046528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789760721.488089:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760721.488156:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27218b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883046528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760721.488163:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789760721.488246:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2517f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883046528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760721.565095:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 325676318075 time 325678277273 state 0x0 ref 1 00000100:00100000:1.0:1789760721.565142:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2517f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863128448:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760721.565189:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae725 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.565208:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760721.565231:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760721.565239:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae725 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.565255:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae725 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.589149:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae725 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.589176:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae725 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.589186:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae725 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.589195:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760721.589200:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae725 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.589209:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae725 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.589228:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae725 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.589236:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae725 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760721.589352:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2517f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863128448:12345-192.168.203.12@tcp:3:dd.500 Request processed in 24229us (190944us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760721.589365:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 206 00000100:00100000:1.0:1789760721.589376:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 325676318075 time 325678277273 state 0x2 ref 0 00000100:00100000:3.0:1789760721.596223:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760721.596322:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863128576 00000100:00100000:0.0:1789760721.596334:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863128576 00000100:00100000:0.0:1789760721.596390:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 325676318075 time 325678277273 state 0x0 ref 1 00000100:00100000:0.0:1789760721.596405:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 325878277273 time 325678277273 state 0x1 ref 1 00000100:00100000:2.0:1789760721.765319:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 325878277273 time 325878504689 state 0x0 ref 1 00000100:00100000:2.0:1789760721.765352:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d1aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863128576:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760721.765394:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043f45fa3/0x3e099f5ef04ae72c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.765429:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760721.765434:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760721.765440:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043f45fa3/0x3e099f5ef04ae72c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760721.765453:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043f45fa3/0x3e099f5ef04ae72c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.796380:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043f45fa3/0x3e099f5ef04ae72c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.796400:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043f45fa3/0x3e099f5ef04ae72c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.796409:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043f45fa3/0x3e099f5ef04ae72c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.796416:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df277dbf000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760721.796420:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043f45fa3/0x3e099f5ef04ae72c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.796430:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043f45fa3/0x3e099f5ef04ae72c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.796448:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043f45fa3/0x3e099f5ef04ae72c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.796455:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043f45fa3/0x3e099f5ef04ae72c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760721.796574:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d1aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863128576:12345-192.168.203.12@tcp:3:dd.500 Request processed in 31231us (200355us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760721.796584:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 207 00000100:00100000:1.0:1789760721.796592:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 325878277273 time 325878504689 state 0x2 ref 0 00000100:00100000:3.0:1789760721.809267:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760721.809430:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863128704 00000100:00100000:1.0:1789760721.809441:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863128704 00000100:00100000:1.0:1789760721.809506:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 325878277273 time 325878504689 state 0x0 ref 1 00000100:00100000:1.0:1789760721.809518:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 326078504689 time 325878504689 state 0x1 ref 1 00000100:00100000:1.0:1789760721.965527:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 326078504689 time 326078704956 state 0x0 ref 1 00000100:00100000:1.0:1789760721.965572:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d1a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863128704:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760721.965628:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae733 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.965648:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789760721.965653:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760721.965660:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae733 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.965679:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae733 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.979278:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae733 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.979311:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae733 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.979321:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae733 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.979328:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760721.979333:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae733 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.979343:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae733 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.979364:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae733 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760721.979371:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae733 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760721.979517:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d1a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863128704:12345-192.168.203.12@tcp:3:dd.500 Request processed in 13961us (170254us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760721.979528:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 208 00000100:00100000:1.0:1789760721.979536:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 326078504689 time 326078704956 state 0x2 ref 0 00000100:00100000:2.0:1789760721.989526:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760721.990500:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863128832 00000100:00100000:0.0:1789760721.990513:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863128832 00000100:00100000:0.0:1789760721.990571:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 326078504689 time 326078704956 state 0x0 ref 1 00000100:00100000:0.0:1789760721.990585:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 326278704956 time 326078704956 state 0x1 ref 1 00010000:00010000:3.0:1789760722.128100:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760722.168715:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 326278704956 time 326281899011 state 0x0 ref 1 00000100:00100000:1.0:1789760722.168766:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25166b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863128832:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760722.168841:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae73a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.168858:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760722.168862:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760722.168870:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae73a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.168885:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae73a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.178673:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae73a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.178702:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae73a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.178712:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae73a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.178718:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760722.178723:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae73a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.178732:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae73a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.178767:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae73a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.178776:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae73a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760722.181826:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25166b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863128832:12345-192.168.203.12@tcp:3:dd.500 Request processed in 13046us (192284us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760722.181841:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 209 00000100:00100000:1.0:1789760722.181849:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 326278704956 time 326281899011 state 0x2 ref 0 00000100:00100000:2.0:1789760722.190424:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760722.190846:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863128960 00000100:00100000:0.0:1789760722.190857:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863128960 00000100:00100000:0.0:1789760722.191095:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 326278704956 time 326281899011 state 0x0 ref 1 00000100:00100000:0.0:1789760722.191108:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 326481899011 time 326281899011 state 0x1 ref 1 00000100:00100000:1.0:1789760722.373888:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 326481899011 time 326487071149 state 0x0 ref 1 00000100:00100000:1.0:1789760722.373926:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df251669f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863128960:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760722.373970:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae741 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.373989:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760722.373993:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760722.373999:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae741 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.374014:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae741 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.383427:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae741 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.383447:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae741 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.383457:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae741 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.383465:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760722.383479:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae741 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.383488:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae741 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.383508:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae741 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.383516:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae741 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760722.383620:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df251669f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863128960:12345-192.168.203.12@tcp:3:dd.500 Request processed in 9709us (193202us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760722.383631:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 210 00000100:00100000:1.0:1789760722.383656:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 326481899011 time 326487071149 state 0x2 ref 0 00000100:00100000:2.0:1789760722.388758:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760722.388882:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863129088 00000100:00100000:1.0:1789760722.388893:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863129088 00000100:00100000:1.0:1789760722.388970:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 326481899011 time 326487071149 state 0x0 ref 1 00000100:00100000:1.0:1789760722.388986:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 326687071149 time 326487071149 state 0x1 ref 1 00000100:00100000:1.0:1789760722.574351:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 326687071149 time 326687533390 state 0x0 ref 1 00000100:00100000:1.0:1789760722.574389:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25166a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863129088:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760722.574440:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae748 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.574459:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760722.574464:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760722.574481:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae748 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.574499:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae748 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.585398:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae748 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.585417:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae748 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.585426:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae748 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.585459:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760722.585464:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae748 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.585483:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae748 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.585503:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae748 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.585510:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae748 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760722.585618:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25166a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863129088:12345-192.168.203.12@tcp:3:dd.500 Request processed in 11244us (196865us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760722.585629:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 211 00000100:00100000:1.0:1789760722.585637:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 326687071149 time 326687533390 state 0x2 ref 0 00000100:00100000:2.0:1789760722.603456:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760722.604129:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863129216 00000100:00100000:0.0:1789760722.604141:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863129216 00000100:00100000:0.0:1789760722.604199:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 326687071149 time 326687533390 state 0x0 ref 1 00000100:00100000:0.0:1789760722.604228:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 326887533390 time 326687533390 state 0x1 ref 1 00000100:00100000:1.0:1789760722.774534:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 326887533390 time 326887720057 state 0x0 ref 1 00000100:00100000:1.0:1789760722.774577:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df251669880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863129216:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760722.774621:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae74f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.774639:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760722.774657:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760722.774664:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae74f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.774678:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae74f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.787658:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae74f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.787679:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae74f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.787695:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae74f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.787703:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760722.787708:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae74f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.787718:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae74f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.787741:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae74f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.787749:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae74f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760722.787880:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df251669880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863129216:12345-192.168.203.12@tcp:3:dd.500 Request processed in 13314us (184428us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760722.787890:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 212 00000100:00100000:1.0:1789760722.787897:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 326887533390 time 326887720057 state 0x2 ref 0 00000100:00100000:0.0:1789760722.796350:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760722.796451:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863129344 00000100:00100000:1.0:1789760722.796462:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863129344 00000100:00100000:1.0:1789760722.796525:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 326887533390 time 326887720057 state 0x0 ref 1 00000100:00100000:1.0:1789760722.796537:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 327087720057 time 326887720057 state 0x1 ref 1 00000100:00100000:1.0:1789760722.974708:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 327087720057 time 327087893428 state 0x0 ref 1 00000100:00100000:1.0:1789760722.974741:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2517f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863129344:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760722.974788:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae756 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.974860:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789760722.974866:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760722.974872:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae756 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760722.974887:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae756 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.002448:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae756 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.002490:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae756 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.002499:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae756 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.002507:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760723.002511:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae756 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.002520:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae756 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.002549:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae756 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.002557:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae756 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760723.002637:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2517f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863129344:12345-192.168.203.12@tcp:3:dd.500 Request processed in 27909us (206291us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760723.002648:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 213 00000100:00100000:1.0:1789760723.002655:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 327087720057 time 327087893428 state 0x2 ref 0 00000100:00100000:3.0:1789760723.013460:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760723.015647:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863129472 00000100:00100000:1.0:1789760723.015696:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863129472 00000100:00100000:1.0:1789760723.015786:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 327087720057 time 327087893428 state 0x0 ref 1 00000100:00100000:1.0:1789760723.015799:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 327287893428 time 327087893428 state 0x1 ref 1 00000100:00080000:2.0:1789760723.016010:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789760723.150974:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760723.175729:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 327287893428 time 327288914377 state 0x0 ref 1 00000100:00100000:1.0:1789760723.175764:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d1aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863129472:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760723.175840:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae75d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.175857:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760723.175862:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760723.175868:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae75d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.175882:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae75d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.185046:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae75d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.185067:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae75d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.185076:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae75d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.185103:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760723.185108:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae75d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.185118:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae75d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.185136:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae75d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.185144:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae75d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760723.185240:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d1aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863129472:12345-192.168.203.12@tcp:3:dd.500 Request processed in 9488us (171788us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760723.185250:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 214 00000100:00100000:1.0:1789760723.185259:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 327287893428 time 327288914377 state 0x2 ref 0 00000100:00100000:3.0:1789760723.196442:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760723.196606:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863129600 00000100:00100000:1.0:1789760723.196617:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863129600 00000100:00100000:1.0:1789760723.199090:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 327287893428 time 327288914377 state 0x0 ref 1 00000100:00100000:1.0:1789760723.199108:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 327488914377 time 327288914377 state 0x1 ref 1 00000100:00100000:1.0:1789760723.375861:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 327488914377 time 327489048915 state 0x0 ref 1 00000100:00100000:1.0:1789760723.375893:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d1a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863129600:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760723.375946:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae764 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.375963:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760723.375967:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760723.375974:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae764 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.376086:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae764 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.392246:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae764 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.392268:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae764 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.392278:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae764 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.392286:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760723.392290:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae764 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.392299:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae764 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.392345:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae764 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.392352:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1dc6706/0x3e099f5ef04ae764 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760723.392441:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d1a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863129600:12345-192.168.203.12@tcp:3:dd.500 Request processed in 16560us (196003us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760723.392454:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 215 00000100:00100000:1.0:1789760723.392471:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 327488914377 time 327489048915 state 0x2 ref 0 00000100:00100000:0.0:1789760723.397625:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760723.397689:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863129728 00000100:00100000:1.0:1789760723.397699:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863129728 00000100:00100000:1.0:1789760723.397769:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 327488914377 time 327489048915 state 0x0 ref 1 00000100:00100000:1.0:1789760723.397782:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 327689048915 time 327489048915 state 0x1 ref 1 00000100:00100000:3.0:1789760723.572115:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760723.572237:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760723.572274:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760723.572473:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863130112 00000100:00100000:1.0:1789760723.572488:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863130112 00000100:00100000:2.0:1789760723.572691:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863129984 00000100:00100000:2.0:1789760723.572703:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863129984 00000100:00100000:1.0:1789760723.572721:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 139 00000100:00100000:1.0:1789760723.572739:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d1ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2351:x1876699863130112:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1789760723.572779:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 140 00000100:00100000:2.0:1789760723.572792:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d1abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+9:2350:x1876699863129984:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1789760723.572879:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d1ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2351:x1876699863130112:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 146us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760723.572888:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 139 00000100:00100000:2.0:1789760723.573027:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d1abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+9:2350:x1876699863129984:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 237us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760723.573036:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 140 00000100:00080000:3.0:1789760723.573225:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760723.575532:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863129856 00000100:00100000:0.0:1789760723.575551:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863129856 00000100:00100000:0.0:1789760723.575639:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 267 00000100:00100000:0.0:1789760723.575651:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247886850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2351:x1876699863129856:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1789760723.575773:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247886850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2351:x1876699863129856:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 124us (3673us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760723.575781:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 267 00000100:00100000:1.0:1789760723.576193:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 327689048915 time 327689380359 state 0x0 ref 1 00000100:00100000:1.0:1789760723.576236:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2517f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863129728:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760723.576273:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000045c63bcc/0x3e099f5ef04ae76b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.576290:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760723.576294:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760723.576300:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045c63bcc/0x3e099f5ef04ae76b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.576313:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045c63bcc/0x3e099f5ef04ae76b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760723.597895:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000045c63bcc/0x3e099f5ef04ae76b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760723.597925:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045c63bcc/0x3e099f5ef04ae76b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760723.597961:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045c63bcc/0x3e099f5ef04ae76b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760723.597969:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760723.597975:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045c63bcc/0x3e099f5ef04ae76b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760723.597987:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045c63bcc/0x3e099f5ef04ae76b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760723.598015:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045c63bcc/0x3e099f5ef04ae76b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760723.598024:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045c63bcc/0x3e099f5ef04ae76b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760723.598124:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2517f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863129728:12345-192.168.203.12@tcp:3:dd.500 Request processed in 21891us (200501us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760723.598135:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 216 00000100:00100000:2.0:1789760723.598144:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 327689048915 time 327689380359 state 0x2 ref 0 00000100:00100000:3.0:1789760723.605290:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760723.605448:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863130240 00000100:00100000:1.0:1789760723.605474:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863130240 00000100:00100000:1.0:1789760723.605542:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 327689048915 time 327689380359 state 0x0 ref 1 00000100:00100000:1.0:1789760723.605571:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 327889380359 time 327689380359 state 0x1 ref 1 00000100:00100000:1.0:1789760723.777427:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 327889380359 time 327890609817 state 0x0 ref 1 00000100:00100000:1.0:1789760723.777483:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d1aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863130240:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760723.777529:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae772 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.777546:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760723.777551:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760723.777557:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae772 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.777599:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae772 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.788322:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae772 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.788344:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae772 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.788353:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae772 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.788361:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760723.788365:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae772 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.788375:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae772 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.788394:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae772 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.788401:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae772 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760723.788762:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d1aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863130240:12345-192.168.203.12@tcp:3:dd.500 Request processed in 11106us (183291us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760723.788773:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 217 00000100:00100000:1.0:1789760723.788781:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 327889380359 time 327890609817 state 0x2 ref 0 00000100:00100000:1.0:1789760723.799991:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760723.800362:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863130368 00000100:00100000:0.0:1789760723.800373:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863130368 00000100:00100000:0.0:1789760723.800437:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 327889380359 time 327890609817 state 0x0 ref 1 00000100:00100000:0.0:1789760723.800449:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 328090609817 time 327890609817 state 0x1 ref 1 00000100:00100000:1.0:1789760723.977593:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 328090609817 time 328090777742 state 0x0 ref 1 00000100:00100000:1.0:1789760723.977628:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df272189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863130368:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760723.977670:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae779 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.977750:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789760723.977756:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760723.977762:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae779 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760723.977780:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae779 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760723.995278:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae779 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760723.995298:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae779 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760723.995321:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae779 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760723.995329:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760723.995334:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae779 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760723.995343:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae779 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760723.995365:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae779 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760723.995372:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaf0cd61/0x3e099f5ef04ae779 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760723.995498:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df272189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863130368:12345-192.168.203.12@tcp:3:dd.500 Request processed in 17883us (195513us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760723.995509:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 218 00000100:00100000:2.0:1789760723.995517:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 328090609817 time 328090777742 state 0x2 ref 0 00000100:00100000:3.0:1789760724.003434:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760724.003953:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863130496 00000100:00100000:1.0:1789760724.003963:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863130496 00000100:00100000:1.0:1789760724.004017:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 328090609817 time 328090777742 state 0x0 ref 1 00000100:00100000:1.0:1789760724.004029:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 328290777742 time 328090777742 state 0x1 ref 1 00010000:00010000:0.0:1789760724.175092:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760724.177871:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 328290777742 time 328291053429 state 0x0 ref 1 00000100:00100000:2.0:1789760724.177906:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863130496:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760724.177950:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001a27016b/0x3e099f5ef04ae780 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760724.177983:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760724.177987:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760724.177995:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a27016b/0x3e099f5ef04ae780 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760724.178010:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a27016b/0x3e099f5ef04ae780 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.221559:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001a27016b/0x3e099f5ef04ae780 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.221580:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a27016b/0x3e099f5ef04ae780 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.221590:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a27016b/0x3e099f5ef04ae780 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.221598:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df277dbfc00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760724.221603:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a27016b/0x3e099f5ef04ae780 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.221613:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a27016b/0x3e099f5ef04ae780 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.221637:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a27016b/0x3e099f5ef04ae780 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.221646:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a27016b/0x3e099f5ef04ae780 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760724.221748:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863130496:12345-192.168.203.12@tcp:3:dd.500 Request processed in 43845us (218310us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760724.221760:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 219 00000100:00100000:1.0:1789760724.221768:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 328290777742 time 328291053429 state 0x2 ref 0 00000100:00100000:3.0:1789760724.236258:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760724.236365:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863130624 00000100:00100000:1.0:1789760724.236375:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863130624 00000100:00100000:1.0:1789760724.236430:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 328290777742 time 328291053429 state 0x0 ref 1 00000100:00100000:1.0:1789760724.236442:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 328491053429 time 328291053429 state 0x1 ref 1 00000100:00100000:1.0:1789760724.378024:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 328491053429 time 328491208935 state 0x0 ref 1 00000100:00100000:1.0:1789760724.378060:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d1a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863130624:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760724.378102:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000de391066/0x3e099f5ef04ae787 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.378119:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760724.378123:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760724.378130:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de391066/0x3e099f5ef04ae787 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.378142:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de391066/0x3e099f5ef04ae787 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.401010:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000de391066/0x3e099f5ef04ae787 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.401029:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de391066/0x3e099f5ef04ae787 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.401037:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de391066/0x3e099f5ef04ae787 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.401060:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c4200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760724.401065:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de391066/0x3e099f5ef04ae787 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.401074:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de391066/0x3e099f5ef04ae787 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.401092:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de391066/0x3e099f5ef04ae787 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.401100:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de391066/0x3e099f5ef04ae787 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760724.401185:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d1a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863130624:12345-192.168.203.12@tcp:3:dd.500 Request processed in 23139us (164931us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760724.401195:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 220 00000100:00100000:1.0:1789760724.401203:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 328491053429 time 328491208935 state 0x2 ref 0 00000100:00100000:3.0:1789760724.407581:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760724.407786:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863130752 00000100:00100000:0.0:1789760724.407797:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863130752 00000100:00100000:0.0:1789760724.407909:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 328491053429 time 328491208935 state 0x0 ref 1 00000100:00100000:0.0:1789760724.407923:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 328691208935 time 328491208935 state 0x1 ref 1 00000100:00100000:0.0:1789760724.559135:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d1a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883046656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789760724.559287:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760724.559391:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883046656 00000100:00100000:1.0:1789760724.559400:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883046656 00000100:00100000:1.0:1789760724.559485:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789760724.559496:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2517f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883046656:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789760724.559563:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1789760724.559617:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241893376 pending 0 free 3754950656 avail 3752853504 00000100:00100000:1.0:1789760724.568201:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2517f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883046656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8698us (8905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760724.568400:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789760724.570975:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d1a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883046656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760724.581667:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 328691208935 time 328694851537 state 0x0 ref 1 00000100:00100000:2.0:1789760724.581701:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d1a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863130752:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760724.581746:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04ae78e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760724.581763:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760724.581768:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760724.581774:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04ae78e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760724.581788:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04ae78e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.595754:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04ae78e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.595776:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04ae78e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.595785:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04ae78e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.595793:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241538e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760724.595798:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04ae78e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.595843:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04ae78e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.595863:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04ae78e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.595871:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04ae78e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760724.595975:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d1a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863130752:12345-192.168.203.12@tcp:3:dd.500 Request processed in 14286us (188400us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760724.595985:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 221 00000100:00100000:1.0:1789760724.596006:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 328691208935 time 328694851537 state 0x2 ref 0 00000100:00100000:3.0:1789760724.607046:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760724.607124:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863130880 00000100:00100000:2.0:1789760724.607134:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863130880 00000100:00100000:2.0:1789760724.607194:0:11799:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 328691208935 time 328694851537 state 0x0 ref 1 00000100:00100000:2.0:1789760724.607221:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 328894851537 time 328694851537 state 0x1 ref 1 00000100:00100000:1.0:1789760724.783953:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 328894851537 time 328897139157 state 0x0 ref 1 00000100:00100000:1.0:1789760724.783986:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d1ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863130880:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760724.784027:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000de391066/0x3e099f5ef04ae795 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.784044:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760724.784048:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760724.784054:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de391066/0x3e099f5ef04ae795 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.784069:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de391066/0x3e099f5ef04ae795 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760724.799207:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000de391066/0x3e099f5ef04ae795 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760724.799227:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de391066/0x3e099f5ef04ae795 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760724.799236:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de391066/0x3e099f5ef04ae795 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760724.799243:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c4200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760724.799247:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de391066/0x3e099f5ef04ae795 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760724.799257:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de391066/0x3e099f5ef04ae795 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760724.799276:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de391066/0x3e099f5ef04ae795 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760724.799284:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de391066/0x3e099f5ef04ae795 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760724.799417:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d1ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863130880:12345-192.168.203.12@tcp:3:dd.500 Request processed in 15443us (192376us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760724.799436:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 222 00000100:00100000:2.0:1789760724.799468:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 328894851537 time 328897139157 state 0x2 ref 0 00000100:00100000:3.0:1789760724.807493:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760724.807649:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863131008 00000100:00100000:1.0:1789760724.807659:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863131008 00000100:00100000:1.0:1789760724.807865:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 328894851537 time 328897139157 state 0x0 ref 1 00000100:00100000:1.0:1789760724.807980:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 329097139157 time 328897139157 state 0x1 ref 1 00000100:00100000:1.0:1789760724.985231:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 329097139157 time 329098414180 state 0x0 ref 1 00000100:00100000:1.0:1789760724.985267:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d1a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863131008:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760724.985309:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c7e236fa/0x3e099f5ef04ae79c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.985345:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789760724.985350:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760724.985357:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7e236fa/0x3e099f5ef04ae79c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760724.985373:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7e236fa/0x3e099f5ef04ae79c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760725.004393:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c7e236fa/0x3e099f5ef04ae79c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760725.004413:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7e236fa/0x3e099f5ef04ae79c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760725.004421:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7e236fa/0x3e099f5ef04ae79c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760725.004428:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c5a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760725.004434:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7e236fa/0x3e099f5ef04ae79c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760725.004444:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7e236fa/0x3e099f5ef04ae79c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760725.004479:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7e236fa/0x3e099f5ef04ae79c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760725.004487:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7e236fa/0x3e099f5ef04ae79c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760725.004568:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d1a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863131008:12345-192.168.203.12@tcp:3:dd.500 Request processed in 19315us (197081us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760725.004579:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 223 00000100:00100000:0.0:1789760725.004587:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 329097139157 time 329098414180 state 0x2 ref 0 00000100:00100000:3.0:1789760725.011612:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760725.011874:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863131136 00000100:00100000:0.0:1789760725.011894:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863131136 00000100:00100000:0.0:1789760725.011965:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 329097139157 time 329098414180 state 0x0 ref 1 00000100:00100000:0.0:1789760725.011977:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 329298414180 time 329098414180 state 0x1 ref 1 00000100:00080000:3.0:1789760725.012321:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760725.185640:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 329298414180 time 329298823671 state 0x0 ref 1 00000100:00100000:1.0:1789760725.185675:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863131136:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760725.185725:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000384391c6/0x3e099f5ef04ae7a3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760725.185746:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760725.185750:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760725.185757:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000384391c6/0x3e099f5ef04ae7a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760725.185772:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000384391c6/0x3e099f5ef04ae7a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760725.197272:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000384391c6/0x3e099f5ef04ae7a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760725.197292:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000384391c6/0x3e099f5ef04ae7a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760725.197316:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000384391c6/0x3e099f5ef04ae7a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760725.197335:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c4c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760725.197339:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000384391c6/0x3e099f5ef04ae7a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760725.197350:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000384391c6/0x3e099f5ef04ae7a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760725.197369:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000384391c6/0x3e099f5ef04ae7a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760725.197377:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000384391c6/0x3e099f5ef04ae7a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760725.197488:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863131136:12345-192.168.203.12@tcp:3:dd.500 Request processed in 11824us (185877us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760725.197500:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 224 00000100:00100000:1.0:1789760725.197508:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 329298414180 time 329298823671 state 0x2 ref 0 00010000:00010000:3.0:1789760725.199994:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760725.204516:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760725.204698:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863131264 00000100:00100000:2.0:1789760725.204708:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863131264 00000100:00100000:2.0:1789760725.204762:0:11799:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 329298414180 time 329298823671 state 0x0 ref 1 00000100:00100000:2.0:1789760725.204774:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 329498823671 time 329298823671 state 0x1 ref 1 00000100:00100000:2.0:1789760725.385798:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 329498823671 time 329498983223 state 0x0 ref 1 00000100:00100000:2.0:1789760725.385875:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df272189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863131264:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760725.386057:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000055b13a45/0x3e099f5ef04ae7aa lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.386075:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760725.386079:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760725.386086:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055b13a45/0x3e099f5ef04ae7aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.386099:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055b13a45/0x3e099f5ef04ae7aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.401547:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000055b13a45/0x3e099f5ef04ae7aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.401568:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055b13a45/0x3e099f5ef04ae7aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.401578:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055b13a45/0x3e099f5ef04ae7aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.401600:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c2000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760725.401605:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055b13a45/0x3e099f5ef04ae7aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.401616:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055b13a45/0x3e099f5ef04ae7aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.401637:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055b13a45/0x3e099f5ef04ae7aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.401644:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055b13a45/0x3e099f5ef04ae7aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760725.401756:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df272189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863131264:12345-192.168.203.12@tcp:3:dd.500 Request processed in 15894us (197243us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760725.401768:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 225 00000100:00100000:2.0:1789760725.401777:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 329498823671 time 329498983223 state 0x2 ref 0 00000100:00100000:3.0:1789760725.406235:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760725.406335:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863131392 00000100:00100000:1.0:1789760725.406345:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863131392 00000100:00100000:1.0:1789760725.406400:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 329498823671 time 329498983223 state 0x0 ref 1 00000100:00100000:1.0:1789760725.406430:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 329698983223 time 329498983223 state 0x1 ref 1 00000100:00100000:0.0:1789760725.585963:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 329698983223 time 329699147574 state 0x0 ref 1 00000100:00100000:0.0:1789760725.585998:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863131392:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760725.586039:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae7b1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760725.586055:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760725.586060:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760725.586066:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae7b1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760725.586081:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae7b1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760725.611363:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae7b1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760725.611384:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae7b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760725.611394:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae7b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760725.611420:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760725.611425:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae7b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760725.611435:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae7b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760725.611468:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae7b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760725.611477:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009a18857/0x3e099f5ef04ae7b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760725.611572:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863131392:12345-192.168.203.12@tcp:3:dd.500 Request processed in 25585us (205347us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760725.611583:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 226 00000100:00100000:0.0:1789760725.611591:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 329698983223 time 329699147574 state 0x2 ref 0 00000100:00100000:1.0:1789760725.623432:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760725.623545:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863131520 00000100:00100000:0.0:1789760725.623555:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863131520 00000100:00100000:0.0:1789760725.623610:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 329698983223 time 329699147574 state 0x0 ref 1 00000100:00100000:0.0:1789760725.623623:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 329899147574 time 329699147574 state 0x1 ref 1 00000100:00100000:1.0:1789760725.786204:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 329899147574 time 329899389516 state 0x0 ref 1 00000100:00100000:1.0:1789760725.786241:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df272188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863131520:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760725.786288:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000384391c6/0x3e099f5ef04ae7b8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760725.786307:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760725.786313:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760725.786332:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000384391c6/0x3e099f5ef04ae7b8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760725.786348:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000384391c6/0x3e099f5ef04ae7b8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.803121:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000384391c6/0x3e099f5ef04ae7b8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.803139:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000384391c6/0x3e099f5ef04ae7b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.803147:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000384391c6/0x3e099f5ef04ae7b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.803170:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c4c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760725.803176:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000384391c6/0x3e099f5ef04ae7b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.803184:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000384391c6/0x3e099f5ef04ae7b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.803204:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000384391c6/0x3e099f5ef04ae7b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760725.803212:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000384391c6/0x3e099f5ef04ae7b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760725.803309:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df272188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863131520:12345-192.168.203.12@tcp:3:dd.500 Request processed in 17082us (179880us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760725.803319:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 227 00000100:00100000:2.0:1789760725.803328:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 329899147574 time 329899389516 state 0x2 ref 0 00000100:00100000:1.0:1789760725.811546:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760725.812143:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863131648 00000100:00100000:2.0:1789760725.812153:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863131648 00000100:00100000:2.0:1789760725.812208:0:11799:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 329899147574 time 329899389516 state 0x0 ref 1 00000100:00100000:2.0:1789760725.812220:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 330099389516 time 329899389516 state 0x1 ref 1 00000100:00100000:1.0:1789760725.986883:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 330099389516 time 330100067231 state 0x0 ref 1 00000100:00100000:1.0:1789760725.986921:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27218b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863131648:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760725.986962:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000078ab58e4/0x3e099f5ef04ae7bf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760725.986979:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789760725.986983:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760725.986990:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078ab58e4/0x3e099f5ef04ae7bf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760725.987024:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078ab58e4/0x3e099f5ef04ae7bf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760726.013111:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000078ab58e4/0x3e099f5ef04ae7bf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760726.013132:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078ab58e4/0x3e099f5ef04ae7bf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760726.013141:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078ab58e4/0x3e099f5ef04ae7bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760726.013149:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c5e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760726.013154:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078ab58e4/0x3e099f5ef04ae7bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760726.013162:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078ab58e4/0x3e099f5ef04ae7bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760726.013182:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078ab58e4/0x3e099f5ef04ae7bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760726.013189:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078ab58e4/0x3e099f5ef04ae7bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760726.013382:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27218b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863131648:12345-192.168.203.12@tcp:3:dd.500 Request processed in 26477us (201840us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760726.013393:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 228 00000100:00100000:1.0:1789760726.013400:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 330099389516 time 330100067231 state 0x2 ref 0 00000100:00100000:2.0:1789760726.026181:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760726.026251:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863131776 00000100:00100000:1.0:1789760726.026263:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863131776 00000100:00100000:1.0:1789760726.026328:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 330099389516 time 330100067231 state 0x0 ref 1 00000100:00100000:1.0:1789760726.026341:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 330300067231 time 330100067231 state 0x1 ref 1 00000100:00100000:0.0:1789760726.097187:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789760726.097695:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2462fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1876699883047040:0@lo:400:kworker.0 00000100:00100000:1.0:1789760726.097777:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760726.097863:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789760726.097870:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2462f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883046912:0@lo:400:kworker.0 00000100:00100000:1.0:1789760726.097892:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760726.097940:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883047040 00000100:00100000:1.0:1789760726.097948:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883047040 00000100:00100000:1.0:1789760726.098003:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883046912 00000100:00100000:1.0:1789760726.098007:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883046912 00000100:00100000:1.0:1789760726.098032:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789760726.098041:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df272188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876699883047040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760726.098092:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df272188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876699883047040:12345-0@lo:400:kworker.0 Request processed in 52us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760726.098099:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789760726.098116:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789760726.098133:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df272188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883046912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760726.098161:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df272188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883046912:12345-0@lo:400:kworker.0 Request processed in 30us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760726.098167:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:1.0:1789760726.098186:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760726.098218:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2462f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883046912:0@lo:400:kworker.0 00000100:00100000:1.0:1789760726.098228:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2462fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1876699883047040:0@lo:400:kworker.0 00000100:00100000:0.0:1789760726.101335:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2462f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883047168:0@lo:400:kworker.0 00000100:00100000:0.0:1789760726.101435:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760726.101499:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d1a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699883046784:0@lo:400:kworker.0 00000100:00100000:0.0:1789760726.101539:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760726.101917:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883047168 00000100:00100000:1.0:1789760726.102038:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883047168 00000100:00100000:1.0:1789760726.102105:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789760726.102115:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2517f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883047168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760726.102173:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2517f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883047168:12345-0@lo:400:kworker.0 Request processed in 59us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760726.102180:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1789760726.109665:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760726.109734:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2462f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883047168:0@lo:400:kworker.0 00000100:00100000:3.0:1789760726.110263:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789760726.110279:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2462f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883047424:0@lo:400:kworker.0 00000100:00100000:3.0:1789760726.110344:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760726.110626:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789760726.110638:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2462fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1876699883047296:0@lo:400:kworker.0 00000100:00100000:0.0:1789760726.110676:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760726.110797:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883047296 00000100:00100000:3.0:1789760726.110830:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883047296 00000100:00100000:3.0:1789760726.110882:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789760726.110906:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2517f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876699883047296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760726.110969:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2517f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876699883047296:12345-0@lo:400:kworker.0 Request processed in 64us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760726.110977:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789760726.111084:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883046784 00000100:00100000:2.0:1789760726.111096:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883046784 00000100:00100000:2.0:1789760726.111132:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789760726.111139:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247885c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3308:x1876699883046784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760726.111175:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247885c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3308:x1876699883046784:12345-0@lo:400:kworker.0 Request processed in 37us (9635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760726.111181:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:0.0:1789760726.111252:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760726.111280:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2462fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1876699883047296:0@lo:400:kworker.0 00000100:00100000:0.0:1789760726.111290:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d1a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e2780560-8e82-4256-94b0-2e524f3bed06:3308:1876699883046784:0@lo:400:kworker.0 00000100:00100000:1.0:1789760726.111365:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883047424 00000100:00100000:1.0:1789760726.111374:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883047424 00000100:00100000:1.0:1789760726.111421:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789760726.111428:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2462fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883047424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760726.111485:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2462fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883047424:12345-0@lo:400:kworker.0 Request processed in 57us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760726.111492:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789760726.111641:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2462f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883047424:0@lo:400:kworker.0 00000100:00080000:0.0:1789760726.111819:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789760726.187047:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 330300067231 time 330300232553 state 0x0 ref 1 00000100:00100000:0.0:1789760726.187081:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25166ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863131776:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760726.187126:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae7c6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760726.187143:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760726.187147:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760726.187153:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae7c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760726.187167:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae7c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760726.221341:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae7c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760726.221361:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae7c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760726.221371:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae7c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760726.221379:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f076200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760726.221383:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae7c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760726.221391:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae7c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760726.221411:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae7c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760726.221418:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089d41ba4/0x3e099f5ef04ae7c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760726.221522:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25166ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863131776:12345-192.168.203.12@tcp:3:dd.500 Request processed in 34453us (195359us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760726.221533:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 229 00000100:00100000:0.0:1789760726.221557:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 330300067231 time 330300232553 state 0x2 ref 0 00010000:00010000:0.0:1789760726.223668:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760726.235476:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760726.235623:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863131904 00000100:00100000:2.0:1789760726.235634:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863131904 00000100:00100000:2.0:1789760726.235695:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 330300067231 time 330300232553 state 0x0 ref 1 00000100:00100000:2.0:1789760726.235708:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 330500232553 time 330300232553 state 0x1 ref 1 00000100:00100000:2.0:1789760726.387219:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 330500232553 time 330500404155 state 0x0 ref 1 00000100:00100000:2.0:1789760726.387258:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2462fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863131904:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760726.387305:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000055b13a45/0x3e099f5ef04ae7cd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760726.387323:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760726.387327:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760726.387334:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055b13a45/0x3e099f5ef04ae7cd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760726.387350:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055b13a45/0x3e099f5ef04ae7cd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760726.407140:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000055b13a45/0x3e099f5ef04ae7cd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760726.407178:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055b13a45/0x3e099f5ef04ae7cd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760726.407187:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055b13a45/0x3e099f5ef04ae7cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760726.407195:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c2000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760726.407200:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055b13a45/0x3e099f5ef04ae7cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760726.407208:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055b13a45/0x3e099f5ef04ae7cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760726.407227:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055b13a45/0x3e099f5ef04ae7cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760726.407235:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055b13a45/0x3e099f5ef04ae7cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760726.407316:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2462fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863131904:12345-192.168.203.12@tcp:3:dd.500 Request processed in 20072us (171844us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760726.407326:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 230 00000100:00100000:2.0:1789760726.407333:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 330500232553 time 330500404155 state 0x2 ref 0 00000100:00100000:1.0:1789760726.422075:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760726.424150:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863132032 00000100:00100000:0.0:1789760726.424164:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863132032 00000100:00100000:0.0:1789760726.424221:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 330500232553 time 330500404155 state 0x0 ref 1 00000100:00100000:0.0:1789760726.424234:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 330700404155 time 330500404155 state 0x1 ref 1 00000100:00100000:1.0:1789760726.588557:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 330700404155 time 330701694124 state 0x0 ref 1 00000100:00100000:1.0:1789760726.588594:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27218aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863132032:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760726.588655:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009683602f/0x3e099f5ef04ae7d4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760726.588673:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760726.588678:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760726.588685:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009683602f/0x3e099f5ef04ae7d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760726.588700:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009683602f/0x3e099f5ef04ae7d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760726.609418:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2517f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883047552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760726.609508:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760726.609656:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883047552 00000100:00100000:2.0:1789760726.609678:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883047552 00000100:00100000:2.0:1789760726.609730:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789760726.609739:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df272188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883047552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789760726.609776:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760726.609862:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df272188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883047552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760726.609870:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789760726.610719:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2517f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883047552:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789760726.613933:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009683602f/0x3e099f5ef04ae7d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760726.613956:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009683602f/0x3e099f5ef04ae7d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760726.613966:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009683602f/0x3e099f5ef04ae7d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760726.613974:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c5c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760726.613978:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009683602f/0x3e099f5ef04ae7d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760726.613988:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009683602f/0x3e099f5ef04ae7d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760726.614009:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009683602f/0x3e099f5ef04ae7d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760726.614018:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009683602f/0x3e099f5ef04ae7d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760726.614129:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27218aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863132032:12345-192.168.203.12@tcp:3:dd.500 Request processed in 25549us (192059us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760726.614139:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 231 00000100:00100000:2.0:1789760726.614147:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 330700404155 time 330701694124 state 0x2 ref 0 00000100:00100000:1.0:1789760726.619228:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760726.619372:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863132160 00000100:00100000:3.0:1789760726.619382:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863132160 00000100:00100000:3.0:1789760726.619449:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 330700404155 time 330701694124 state 0x0 ref 1 00000100:00100000:3.0:1789760726.619462:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 330901694124 time 330701694124 state 0x1 ref 1 00000100:00100000:0.0:1789760726.788666:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 330901694124 time 330901852287 state 0x0 ref 1 00000100:00100000:0.0:1789760726.788700:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27218b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863132160:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760726.788756:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae7db lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760726.788782:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760726.788787:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760726.788793:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae7db lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760726.788843:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae7db lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760726.807590:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae7db lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760726.807620:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae7db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760726.807630:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae7db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760726.807639:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24f077c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760726.807643:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae7db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760726.807656:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae7db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760726.807675:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae7db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760726.807683:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1351256/0x3e099f5ef04ae7db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760726.807783:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27218b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863132160:12345-192.168.203.12@tcp:3:dd.500 Request processed in 19093us (188560us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760726.807793:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 232 00000100:00100000:2.0:1789760726.807843:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 330901694124 time 330901852287 state 0x2 ref 0 00000100:00100000:1.0:1789760726.823592:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760726.823708:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863132288 00000100:00100000:2.0:1789760726.823718:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863132288 00000100:00100000:2.0:1789760726.823773:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 330901694124 time 330901852287 state 0x0 ref 1 00000100:00100000:2.0:1789760726.823786:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 331101852287 time 330901852287 state 0x1 ref 1 00000100:00100000:2.0:1789760726.988766:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 331101852287 time 331101949436 state 0x0 ref 1 00000100:00100000:2.0:1789760726.988818:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df272189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863132288:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760726.988864:0:11796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04ae7e2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760726.988881:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789760726.988886:0:11796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760726.988892:0:11796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04ae7e2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760726.988908:0:11796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04ae7e2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760727.005962:0:11796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04ae7e2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760727.005995:0:11796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04ae7e2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760727.006004:0:11796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04ae7e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760727.006011:0:11796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760727.006016:0:11796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04ae7e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760727.006027:0:11796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04ae7e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760727.006046:0:11796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04ae7e2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760727.006053:0:11796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04ae7e2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760727.006134:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df272189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863132288:12345-192.168.203.12@tcp:3:dd.500 Request processed in 17348us (182548us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760727.006145:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 233 00000100:00100000:2.0:1789760727.006153:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 331101852287 time 331101949436 state 0x2 ref 0 00000100:00100000:3.0:1789760727.013028:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760727.014331:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863132416 00000100:00100000:2.0:1789760727.014367:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863132416 00000100:00100000:2.0:1789760727.014466:0:11799:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 331101852287 time 331101949436 state 0x0 ref 1 00000100:00100000:2.0:1789760727.014479:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 331301949436 time 331101949436 state 0x1 ref 1 00000100:00080000:0.0:1789760727.016629:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760727.188861:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 331301949436 time 331302045193 state 0x0 ref 1 00000100:00100000:2.0:1789760727.188893:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2462fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863132416:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760727.188953:0:11798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04ae7e9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760727.188969:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760727.188973:0:11798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760727.188978:0:11798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04ae7e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760727.189133:0:11798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04ae7e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760727.213407:0:11798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04ae7e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760727.213428:0:11798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04ae7e9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760727.213450:0:11798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04ae7e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760727.213480:0:11798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760727.213485:0:11798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04ae7e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760727.213495:0:11798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04ae7e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760727.213722:0:11798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04ae7e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760727.213732:0:11798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04ae7e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760727.216113:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2462fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863132416:12345-192.168.203.12@tcp:3:dd.500 Request processed in 27224us (203084us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760727.216127:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 234 00000100:00100000:2.0:1789760727.216136:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 331301949436 time 331302045193 state 0x2 ref 0 00000100:00100000:3.0:1789760727.218673:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760727.218825:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863132672 00000100:00100000:1.0:1789760727.218834:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863132672 00000100:00100000:1.0:1789760727.218907:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:1.0:1789760727.218920:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2462f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+9:10550:x1876699863132672:12345-192.168.203.12@tcp:35:dd.500 00000100:00100000:1.0:1789760727.222333:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2462f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+10:10550:x1876699863132672:12345-192.168.203.12@tcp:35:dd.500 Request processed in 3410us (3674us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1789760727.222344:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00080000:0.0:1789760727.223105:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789760727.250878:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760727.318584:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760727.318919:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863132800 00000100:00100000:2.0:1789760727.318938:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863132800 00000100:00100000:2.0:1789760727.319278:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:2.0:1789760727.319291:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df260390050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1da0113a-370d-4d79-883c-54efc174697f+6:5585:x1876699863132800:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760727.319307:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760727.319347:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059a05cf5/0x3e099f5ef04ae52d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1aa expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760727.319394:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760727.319461:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df260390050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1da0113a-370d-4d79-883c-54efc174697f+5:5585:x1876699863132800:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 173us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760727.320607:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:3.0:1789760727.340846:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760727.341277:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863132928 00000100:00100000:1.0:1789760727.341288:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863132928 00000100:00100000:1.0:1789760727.341394:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:1.0:1789760727.341419:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2462f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+10:10222:x1876699863132928:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1789760727.341452:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760727.342391:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861ec00/0x3e099f5ef04ae7f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d1b1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.342536:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861fa00/0x3e099f5ef04ae7f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.342550:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861fa00/0x3e099f5ef04ae7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.342573:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861fa00/0x3e099f5ef04ae7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789760727.342609:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 16384 00000004:00200000:1.0:1789760727.342613:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789760727.342629:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861fa00/0x3e099f5ef04ae7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.342650:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861ec00/0x3e099f5ef04ae7f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1b1 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.342664:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861fa00/0x3e099f5ef04ae7f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1b1 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.342670:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df2502f3100) 00010000:00010000:1.0:1789760727.342672:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789760727.342674:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df25861fa00, rc 0) 00000100:00100000:1.0:1789760727.342734:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2462f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+11:10222:x1876699863132928:12345-192.168.203.12@tcp:101:bash.0 Request processed in 1319us (1898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760727.342748:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:3.0:1789760727.355318:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760727.355450:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863133184 00000100:00100000:1.0:1789760727.355462:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863133184 00000100:00100000:1.0:1789760727.355527:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:1.0:1789760727.355537:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2462f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+11:10565:x1876699863133184:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:1.0:1789760727.355557:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760727.355577:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861ec00/0x3e099f5ef04ae7fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d1b8 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789760727.355679:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 16384 00010000:00010000:1.0:1789760727.355850:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861ec00/0x3e099f5ef04ae7fe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1b8 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.355875:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df2502f3500) 00010000:00010000:1.0:1789760727.355878:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789760727.355884:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861ec00/0x3e099f5ef04ae7fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1b8 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.355899:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df25861ec00, rc 0) 00000100:00100000:1.0:1789760727.355975:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2462f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+12:10565:x1876699863133184:12345-192.168.203.12@tcp:101:rm.0 Request processed in 439us (670us total) trans 4294967357 rc 301/301 00000100:00100000:1.0:1789760727.355982:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:3.0:1789760727.366266:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760727.366366:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863133312 00000100:00100000:1.0:1789760727.366376:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863133312 00000100:00100000:1.0:1789760727.366444:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:1.0:1789760727.366454:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24767c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+12:10565:x1876699863133312:12345-192.168.203.12@tcp:37:rm.0 00000100:00100000:1.0:1789760727.377515:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24767c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+12:10565:x1876699863133312:12345-192.168.203.12@tcp:37:rm.0 Request processed in 11052us (11248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760727.377528:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:3.0:1789760727.381119:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760727.381191:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863133568 00000100:00100000:2.0:1789760727.381200:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863133568 00000100:00100000:2.0:1789760727.381255:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:2.0:1789760727.381266:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2462f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+12:10565:x1876699863133568:12345-192.168.203.12@tcp:35:rm.0 00000100:00100000:2.0:1789760727.381640:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2462f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+13:10565:x1876699863133568:12345-192.168.203.12@tcp:35:rm.0 Request processed in 376us (528us total) trans 4294967358 rc 0/0 00000100:00100000:2.0:1789760727.381648:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:3.0:1789760727.384475:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760727.384696:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863133824 00000100:00100000:2.0:1789760727.384706:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863133824 00000100:00100000:2.0:1789760727.384795:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:2.0:1789760727.384830:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2462fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+13:10565:x1876699863133824:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:2.0:1789760727.384853:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760727.384886:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04ae80c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d1bf expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760727.385233:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3000/0x3e099f5ef04ae813 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760727.385248:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3000/0x3e099f5ef04ae813 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760727.385259:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3000/0x3e099f5ef04ae813 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760727.385284:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 16384 00010000:00010000:2.0:1789760727.385396:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04ae80c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1bf expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760727.385415:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3000/0x3e099f5ef04ae813 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1bf expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760727.385424:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df2502f3100) 00010000:00010000:2.0:1789760727.385426:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789760727.385429:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2517f3000, rc 0) 00000100:00100000:2.0:1789760727.385499:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2462fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+15:10565:x1876699863133824:12345-192.168.203.12@tcp:101:rm.0 Request processed in 693us (1031us total) trans 4294967359 rc 0/0 00000100:00100000:2.0:1789760727.385506:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:3.0:1789760727.387982:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760727.388130:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863133952 00000100:00100000:1.0:1789760727.388139:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863133952 00000100:00100000:1.0:1789760727.388199:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 89 00000100:00100000:1.0:1789760727.388210:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2462f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+15:10565:x1876699863133952:12345-192.168.203.12@tcp:41:rm.0 00000004:00000024:1.0:1789760727.388268:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7614758912 avail 7610564608 00000100:00100000:1.0:1789760727.388341:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2462f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+15:10565:x1876699863133952:12345-192.168.203.12@tcp:41:rm.0 Request processed in 132us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760727.388348:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 89 00000100:00100000:3.0:1789760727.390706:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760727.390837:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863134208 00000100:00100000:1.0:1789760727.390844:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863134208 00000100:00100000:1.0:1789760727.390906:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 90 00000100:00100000:1.0:1789760727.390916:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2462f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+15:10565:x1876699863134208:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:1.0:1789760727.390982:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789760727.391008:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66a00/0x3e099f5ef04ae51f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1a3 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.391032:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24f077000/0x3e099f5ef04ae1d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d180 expref: 14 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.391044:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df25b60d100) 00010000:00010000:1.0:1789760727.391058:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861fa00/0x3e099f5ef04ae7f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1b1 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.391086:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df2502f3100) 00010000:00010000:1.0:1789760727.391090:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789760727.391109:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f200/0x3e099f5ef04ae821 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.391123:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f200/0x3e099f5ef04ae821 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.391132:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f200/0x3e099f5ef04ae821 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.391146:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e400/0x3e099f5ef04ae828 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.391154:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e400/0x3e099f5ef04ae828 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.391160:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e400/0x3e099f5ef04ae828 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.391532:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e800/0x3e099f5ef04ae82f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.391541:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e800/0x3e099f5ef04ae82f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.391549:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e800/0x3e099f5ef04ae82f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789760727.392625:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1789760727.392637:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 331505834293ns, next at 332505831879ns, rc = 0 00010000:00010000:1.0:1789760727.392707:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f800/0x3e099f5ef04ae836 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.392719:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f800/0x3e099f5ef04ae836 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.392729:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f800/0x3e099f5ef04ae836 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.392737:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f800/0x3e099f5ef04ae836 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.392742:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f800/0x3e099f5ef04ae836 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.392748:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f800/0x3e099f5ef04ae836 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.392775:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789760727.392796:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e800/0x3e099f5ef04ae82f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.392822:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e800/0x3e099f5ef04ae82f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.392828:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e800/0x3e099f5ef04ae82f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760727.392829:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789760727.392839:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861e800 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760727.392840:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f800/0x3e099f5ef04ae836 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.392844:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e800/0x3e099f5ef04ae82f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760727.392853:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861f800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760727.392857:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e800/0x3e099f5ef04ae82f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760727.392859:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f800/0x3e099f5ef04ae836 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760727.392872:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f800/0x3e099f5ef04ae836 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.392882:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df25b60d400) 00010000:00010000:1.0:1789760727.392886:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789760727.392928:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8df25b60d400) 00010000:00010000:2.0:1789760727.392932:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789760727.392937:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f800/0x3e099f5ef04ae836 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.393326:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e800/0x3e099f5ef04ae82f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.393334:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e800/0x3e099f5ef04ae82f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.393351:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f200/0x3e099f5ef04ae821 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.393357:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f200/0x3e099f5ef04ae821 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.393364:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f200/0x3e099f5ef04ae821 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.393369:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861f200 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:1.0:1789760727.393372:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f200/0x3e099f5ef04ae821 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.393378:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f200/0x3e099f5ef04ae821 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.393387:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df2502f3100) 00010000:00010000:1.0:1789760727.393389:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760727.393392:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f200/0x3e099f5ef04ae821 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.393397:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f200/0x3e099f5ef04ae821 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789760727.393416:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000066505805 reply state 00000000f613e88b transno 4294967360 ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e400/0x3e099f5ef04ae828 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760727.393425:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789760727.393551:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2462f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+14:10565:x1876699863134208:12345-192.168.203.12@tcp:36:rm.0 Request processed in 2634us (2850us total) trans 4294967360 rc 0/0 00010000:00010000:2.0:1789760727.393559:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f800/0x3e099f5ef04ae836 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760727.393561:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 90 00010000:00010000:2.0:1789760727.393584:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760727.393587:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760727.393590:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760727.397228:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760727.397281:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863134464 00000100:00100000:2.0:1789760727.397290:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863134464 00000100:00100000:2.0:1789760727.397338:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:2.0:1789760727.397347:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2462faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+14:10565:x1876699863134464:12345-192.168.203.12@tcp:35:rm.0 00010000:00010000:1.0:1789760727.397592:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e400/0x3e099f5ef04ae828 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.397603:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e400/0x3e099f5ef04ae828 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.397610:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e400/0x3e099f5ef04ae828 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.397615:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861e400 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:1.0:1789760727.397619:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e400/0x3e099f5ef04ae828 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.397626:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e400/0x3e099f5ef04ae828 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.397641:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x4009f790 (ffff8df25b60d800) 00010000:00010000:1.0:1789760727.397644:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760727.397648:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e400/0x3e099f5ef04ae828 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760727.397660:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e400/0x3e099f5ef04ae828 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760727.398515:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2462faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+14:10565:x1876699863134464:12345-192.168.203.12@tcp:35:rm.0 Request processed in 1164us (1293us total) trans 4294967361 rc 0/0 00000100:00100000:2.0:1789760727.398525:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:1.0:1789760727.401287:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760727.401374:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863134720 00000100:00100000:3.0:1789760727.401384:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863134720 00000100:00100000:3.0:1789760727.401473:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 91 00000100:00100000:3.0:1789760727.401483:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27218a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+14:10565:x1876699863134720:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:3.0:1789760727.401537:0:7279:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789760727.401562:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3000/0x3e099f5ef04ae813 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1bf expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.401600:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a66000/0x3e099f5ef04ae19f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d172 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.401611:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df2502f3100) 00010000:00010000:3.0:1789760727.401626:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df243a67e00/0x3e099f5ef04ae13d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d15d expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.401634:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df2502f3500) 00010000:00010000:3.0:1789760727.401640:0:7279:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789760727.401676:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfa00/0x3e099f5ef04ae83d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.401687:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfa00/0x3e099f5ef04ae83d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.401697:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfa00/0x3e099f5ef04ae83d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.401750:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbec00/0x3e099f5ef04ae844 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.401757:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbec00/0x3e099f5ef04ae844 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.401763:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbec00/0x3e099f5ef04ae844 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.402302:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae84b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.402321:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae84b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.402329:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae84b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760727.403055:0:7279:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x9:0x0]: returning size 16384 00010000:00010000:3.0:1789760727.403070:0:7279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae84b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.403078:0:7279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae84b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.403085:0:7279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae84b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.403091:0:7279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df277dbfe00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760727.403095:0:7279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae84b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.403102:0:7279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae84b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.403112:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8df245dcca00) 00010000:00010000:3.0:1789760727.403114:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789760727.403118:0:7279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae84b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.403124:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae84b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.403140:0:7279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfa00/0x3e099f5ef04ae83d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.403151:0:7279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfa00/0x3e099f5ef04ae83d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.403157:0:7279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfa00/0x3e099f5ef04ae83d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.403162:0:7279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df277dbfa00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760727.403165:0:7279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfa00/0x3e099f5ef04ae83d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.403171:0:7279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfa00/0x3e099f5ef04ae83d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.403178:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df245dcc000) 00010000:00010000:3.0:1789760727.403180:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760727.403183:0:7279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfa00/0x3e099f5ef04ae83d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.403188:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfa00/0x3e099f5ef04ae83d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760727.403198:0:7279:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009946f453 reply state 00000000e2d50d5f transno 4294967362 ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbec00/0x3e099f5ef04ae844 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760727.403206:0:7279:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789760727.403316:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27218a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+13:10565:x1876699863134720:12345-192.168.203.12@tcp:36:rm.0 Request processed in 1831us (2035us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1789760727.403324:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 91 00010000:00010000:3.0:1789760727.412023:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbec00/0x3e099f5ef04ae844 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.412057:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbec00/0x3e099f5ef04ae844 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.412066:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbec00/0x3e099f5ef04ae844 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.412072:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df277dbec00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760727.412076:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbec00/0x3e099f5ef04ae844 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.412084:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbec00/0x3e099f5ef04ae844 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.412100:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff8df245dcc800) 00010000:00010000:3.0:1789760727.412104:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760727.412108:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbec00/0x3e099f5ef04ae844 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760727.412114:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbec00/0x3e099f5ef04ae844 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760728.212242:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967360 is committed 00000004:00080000:3.0:1789760728.212254:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:3.0:1789760728.212283:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967361 is committed 00000001:00080000:3.0:1789760728.212292:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967362 is committed 00000100:00100000:2.0:1789760728.212545:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2517f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883047680:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789760728.212606:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760728.212742:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883047680 00000100:00100000:1.0:1789760728.212750:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883047680 00000100:00100000:1.0:1789760728.212838:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789760728.212849:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df251668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883047680:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789760728.212875:0:6694:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:1.0:1789760728.212906:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 104857600, mtime: 0x6aad94c2, atime: 0x6aad94ae, ctime: 0x6aad94c2, blocks: 0x3200b 00010000:00010000:1.0:1789760728.212914:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04ae852 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760728.212931:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1789760728.212935:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760728.212942:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04ae852 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760728.212957:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04ae852 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760728.212968:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04ae852 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760728.212975:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04ae852 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760728.212992:0:6694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789760728.213175:0:7646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789760728.213183:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04ae852 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760728.213205:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861e400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760728.213209:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04ae852 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760728.213219:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04ae852 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760728.213232:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04ae852 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760728.213238:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04ae852 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760728.213252:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760728.213254:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760728.213255:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789760728.213669:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760728.217417:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df251668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1876699883047680:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4563us (4803us total) trans 4294967425 rc 0/0 00000100:00100000:1.0:1789760728.217451:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000004:00080000:3.0:1789760728.217528:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df2517f4e00/2, rc 0, transno 4294967425 00000100:00100000:3.0:1789760728.217534:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2517f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883047680:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789760728.270986:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760728.698603:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760728.698653:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760728.698693:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760728.698695:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863134848 00000100:00100000:0.0:1789760728.698705:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863134848 00000100:00100000:2.0:1789760728.698743:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760728.698761:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 269 00000100:00100000:0.0:1789760728.698772:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2351:x1876699863134848:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1789760728.698778:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863134976 00000100:00100000:2.0:1789760728.698783:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863134976 00000100:00100000:2.0:1789760728.698841:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863135232 00000100:00100000:2.0:1789760728.698845:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863135232 00000100:00100000:0.0:1789760728.698865:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2351:x1876699863134848:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 95us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760728.698875:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 269 00000100:00100000:2.0:1789760728.698886:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 144 00000100:00100000:2.0:1789760728.698896:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25166bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863134976:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1789760728.699545:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25166bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863134976:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 43us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760728.699562:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 144 00000100:00100000:2.0:1789760728.699583:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 145 00000100:00100000:2.0:1789760728.699591:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25166a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2351:x1876699863135232:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1789760728.699627:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25166a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2351:x1876699863135232:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 37us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760728.699634:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 145 00000100:00100000:1.0:1789760728.699861:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863135104 00000100:00100000:1.0:1789760728.699867:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863135104 00000100:00100000:1.0:1789760728.701187:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:1.0:1789760728.701201:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25166b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863135104:12345-192.168.203.12@tcp:400:kworker.0 00000100:00080000:3.0:1789760728.701885:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760728.702710:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25166b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863135104:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 1506us (4050us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760728.702723:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 84 00010000:00010000:3.0:1789760729.296738:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789760729.607575:0:11977:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 333720770536ns, next at 332505831879ns, rc = 0 00000004:00080000:2.0:1789760729.608034:0:11977:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 333721230787ns, next at 295885464442ns, rc = 0 00000004:00080000:0.0:1789760729.617184:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1789760729.617217:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:1.0:1789760729.680090:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789760729.680116:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df251669c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883047808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760729.680184:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760729.680665:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883047808 00000100:00100000:2.0:1789760729.680673:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883047808 00000100:00100000:2.0:1789760729.680717:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789760729.680726:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c6e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876699883047808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789760729.680761:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241893376 pending 0 free 3754950656 avail 3752853504 00000100:00100000:2.0:1789760729.680830:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c6e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876699883047808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760729.680837:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789760729.681257:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df251669c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883047808:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789760730.318937:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760731.215071:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df251669500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883047936:0@lo:400:kworker.0 00000100:00100000:3.0:1789760731.215144:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760731.215446:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883047936 00000100:00100000:1.0:1789760731.215454:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883047936 00000100:00100000:1.0:1789760731.215505:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789760731.215513:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247884050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883047936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760731.216554:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df251669180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883048064:0@lo:400:kworker.0 00000100:00100000:0.0:1789760731.216602:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760731.216653:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883048064 00000100:00100000:0.0:1789760731.216659:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883048064 00000100:00100000:0.0:1789760731.216698:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789760731.216705:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2517f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883048064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760731.216747:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2517f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883048064:12345-0@lo:400:kworker.0 Request processed in 42us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760731.216753:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789760731.216789:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df251669180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883048064:0@lo:400:kworker.0 00000100:00100000:1.0:1789760731.219675:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247884050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883047936:12345-0@lo:400:kworker.0 Request processed in 4154us (4522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760731.219690:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789760731.222165:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df251669c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883048320:0@lo:400:kworker.0 00000100:00100000:0.0:1789760731.222242:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760731.222287:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789760731.222294:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df251669180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1876699883048192:0@lo:400:kworker.0 00000100:00100000:0.0:1789760731.222318:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760731.222349:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883048192 00000100:00100000:0.0:1789760731.222356:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883048192 00000100:00100000:0.0:1789760731.222420:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789760731.222429:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2517f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876699883048192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760731.222478:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2517f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876699883048192:12345-0@lo:400:kworker.0 Request processed in 50us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760731.222485:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1789760731.222517:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760731.222529:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258558e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883048576:0@lo:400:kworker.0 00000100:00100000:0.0:1789760731.222569:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760731.222586:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789760731.222591:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258559180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1876699883048448:0@lo:400:kworker.0 00000100:00100000:0.0:1789760731.222611:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760731.222633:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883048448 00000100:00100000:0.0:1789760731.222637:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883048448 00000100:00100000:0.0:1789760731.222668:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789760731.222674:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2517f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876699883048448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760731.222707:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2517f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876699883048448:12345-0@lo:400:kworker.0 Request processed in 34us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760731.222713:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:0.0:1789760731.222730:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760731.222755:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df251669180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1876699883048192:0@lo:400:kworker.0 00000100:00100000:0.0:1789760731.222782:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258559180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1876699883048448:0@lo:400:kworker.0 00000100:00100000:3.0:1789760731.222887:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df251669500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883047936:0@lo:400:kworker.0 00000100:00100000:2.0:1789760731.223151:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883048320 00000100:00100000:2.0:1789760731.223156:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883048320 00000100:00100000:2.0:1789760731.223199:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883048576 00000100:00100000:2.0:1789760731.223203:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883048576 00000100:00100000:2.0:1789760731.223222:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789760731.223229:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2517f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1876699883048320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760731.223268:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2517f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1876699883048320:12345-0@lo:400:kworker.0 Request processed in 39us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760731.223275:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789760731.223300:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789760731.223308:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2517f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883048576:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789760731.223313:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789760731.223317:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760731.223347:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2517f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883048576:12345-0@lo:400:kworker.0 Request processed in 41us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760731.223354:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789760731.223382:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258558e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883048576:0@lo:400:kworker.0 00000100:00100000:0.0:1789760731.223934:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df251669c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883048320:0@lo:400:kworker.0 00010000:00010000:0.0:1789760731.345587:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760731.727230:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789760731.727254:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2517f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883048704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760731.727336:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760731.729569:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883048704 00000100:00100000:3.0:1789760731.729583:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883048704 00000100:00100000:3.0:1789760731.732374:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789760731.732407:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258558e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883048704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789760731.732576:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760731.732820:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258558e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883048704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 416us (5466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760731.732827:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789760731.733854:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2517f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883048704:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789760732.370459:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789760732.850361:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967425 is committed 00010000:00010000:0.0:1789760733.390980:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760733.811559:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760733.811598:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760733.811632:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760733.811657:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760733.811674:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863135360 00000100:00100000:1.0:1789760733.811682:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863135616 00000100:00100000:3.0:1789760733.811685:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863135360 00000100:00100000:1.0:1789760733.811689:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863135616 00000100:00100000:0.0:1789760733.811722:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863135488 00000100:00100000:0.0:1789760733.811727:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863135488 00000100:00100000:3.0:1789760733.811744:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 271 00000100:00100000:1.0:1789760733.811749:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:0.0:1789760733.811755:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863135744 00000100:00100000:3.0:1789760733.811758:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247886450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2351:x1876699863135360:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1789760733.811759:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863135744 00000100:00100000:1.0:1789760733.811760:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df272189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863135616:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1789760733.811779:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 149 00000100:00100000:0.0:1789760733.811786:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27218b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863135488:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760733.811920:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247886450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2351:x1876699863135360:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 166us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760733.811928:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 271 00000100:00100000:1.0:1789760733.813398:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df272189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863135616:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 1623us (1782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760733.813409:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:1.0:1789760733.813452:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 150 00000100:00100000:1.0:1789760733.813462:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df272188700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2351:x1876699863135744:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1789760733.813503:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df272188700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2351:x1876699863135744:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 44us (1844us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760733.813509:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 150 00000100:00080000:1.0:1789760733.813535:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789760733.813541:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760733.817206:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27218b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863135488:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 5409us (5562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760733.817232:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 149 00010000:00010000:2.0:1789760734.423740:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760734.800853:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258559180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883048832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760734.800972:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760734.801165:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883048832 00000100:00100000:2.0:1789760734.801174:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883048832 00000100:00100000:2.0:1789760734.801233:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789760734.801249:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27218ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883048832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789760734.801401:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241893376 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789760734.801546:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760734.801625:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27218ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883048832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 375us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760734.801633:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789760734.801946:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967425 gen 2 00000004:00080000:1.0:1789760734.801953:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df2517f4e00, transno 4294967425 00000100:00100000:1.0:1789760734.802028:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258559180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883048832:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789760735.440215:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760736.335313:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2517f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883049216:0@lo:400:kworker.0 00000100:00100000:0.0:1789760736.335390:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760736.335408:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2517f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883049088:0@lo:400:kworker.0 00000100:00100000:1.0:1789760736.335446:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760736.335472:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2517f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883049600:0@lo:400:kworker.0 00000100:00100000:1.0:1789760736.335498:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760736.335525:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789760736.335531:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2517f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699883048960:0@lo:400:kworker.0 00000100:00100000:1.0:1789760736.335561:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760736.335612:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789760736.335623:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2517f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883049344:0@lo:400:kworker.0 00000100:00100000:1.0:1789760736.335890:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2517f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1876699883049472:0@lo:400:kworker.0 00000100:00100000:0.0:1789760736.336200:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760736.336234:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760736.336254:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883049216 00000100:00100000:0.0:1789760736.336262:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883049216 00000100:00100000:1.0:1789760736.336279:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883049088 00000100:00100000:1.0:1789760736.336285:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883049088 00000100:00100000:0.0:1789760736.336319:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883049472 00000100:00100000:0.0:1789760736.336324:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883049472 00000100:00100000:3.0:1789760736.336351:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883049600 00000100:00100000:3.0:1789760736.336359:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883049600 00000100:00100000:3.0:1789760736.336401:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883049344 00000100:00100000:3.0:1789760736.336412:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883049344 00000100:00100000:3.0:1789760736.336441:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789760736.336450:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883049600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760736.336512:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883049600:12345-0@lo:400:kworker.0 Request processed in 63us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760736.336519:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789760736.336534:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789760736.336540:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2517f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883049344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760736.336573:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2517f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883049344:12345-0@lo:400:kworker.0 Request processed in 33us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760736.336579:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789760736.336712:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2517f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883049344:0@lo:400:kworker.0 00000100:00100000:3.0:1789760736.336743:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2517f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883049600:0@lo:400:kworker.0 00000100:00100000:1.0:1789760736.337454:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789760736.337465:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2517f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883049216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760736.337519:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2517f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883049216:12345-0@lo:400:kworker.0 Request processed in 57us (2129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760736.337525:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789760736.337543:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789760736.337550:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df272188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883049088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760736.337597:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df272188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883049088:12345-0@lo:400:kworker.0 Request processed in 48us (2150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760736.337624:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789760736.337635:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876699883049472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760736.337673:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876699883049472:12345-0@lo:400:kworker.0 Request processed in 41us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760736.337680:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:0.0:1789760736.337700:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789760736.337705:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789760736.337707:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760736.337778:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789760736.337919:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883048960 00000100:00100000:3.0:1789760736.337926:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883048960 00000100:00100000:3.0:1789760736.338125:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789760736.338133:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:3311:x1876699883048960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760736.338178:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:3311:x1876699883048960:12345-0@lo:400:kworker.0 Request processed in 47us (2616us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760736.338184:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789760736.338241:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2517f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883049216:0@lo:400:kworker.0 00000100:00100000:3.0:1789760736.338271:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2517f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699883048960:0@lo:400:kworker.0 00000100:00100000:3.0:1789760736.338283:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2517f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1876699883049472:0@lo:400:kworker.0 00000100:00100000:3.0:1789760736.338294:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2517f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883049088:0@lo:400:kworker.0 00010000:00010000:2.0:1789760736.464575:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760736.847155:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789760736.847179:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2517f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883049728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760736.847346:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760736.850739:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883049728 00000100:00100000:0.0:1789760736.850754:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883049728 00000100:00100000:0.0:1789760736.850846:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789760736.850859:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883049728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789760736.850910:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760736.851000:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883049728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (3653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760736.851007:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789760736.852022:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2517f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883049728:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789760737.487824:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760738.511004:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760738.932669:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760738.932716:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760738.932750:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760738.932787:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760738.932901:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863136000 00000100:00100000:0.0:1789760738.932926:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863136000 00000100:00100000:0.0:1789760738.932995:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863136256 00000100:00100000:0.0:1789760738.932999:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863136256 00000100:00100000:0.0:1789760738.933022:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 154 00000100:00100000:0.0:1789760738.933031:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863136000:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1789760738.933114:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863136000:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 81us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760738.933122:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 154 00000100:00100000:0.0:1789760738.933141:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 155 00000100:00100000:0.0:1789760738.933147:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2350:x1876699863136256:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1789760738.933173:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2350:x1876699863136256:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760738.933179:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 155 00000100:00080000:1.0:1789760738.933235:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760738.934129:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863135872 00000100:00100000:3.0:1789760738.934137:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863135872 00000100:00100000:3.0:1789760738.934227:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 273 00000100:00100000:3.0:1789760738.934236:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247886c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2350:x1876699863135872:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760738.934296:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247886c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2350:x1876699863135872:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 61us (1544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760738.934304:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 273 00000100:00100000:2.0:1789760738.934467:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863136128 00000100:00100000:2.0:1789760738.934472:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863136128 00000100:00100000:2.0:1789760738.934520:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 90 00000100:00100000:2.0:1789760738.934527:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863136128:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1789760738.934575:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863136128:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 48us (1786us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760738.934593:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 90 00000100:00080000:0.0:1789760738.936338:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789760739.536845:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760739.919843:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789760739.919865:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258559180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883049856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760739.919939:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760739.920582:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883049856 00000100:00100000:0.0:1789760739.920595:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883049856 00000100:00100000:0.0:1789760739.920656:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789760739.920666:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883049856:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789760739.920666:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789760739.920702:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241893376 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760739.920765:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883049856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760739.920772:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789760739.920946:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258559180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883049856:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789760740.562097:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760741.455620:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883049984:0@lo:400:kworker.0 00000100:00100000:2.0:1789760741.455691:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760741.455841:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258559180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883050112:0@lo:400:kworker.0 00000100:00100000:3.0:1789760741.455874:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760741.455961:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883049984 00000100:00100000:0.0:1789760741.455969:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883049984 00000100:00100000:0.0:1789760741.456024:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1789760741.456034:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247887050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883049984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760741.457291:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883050112 00000100:00100000:3.0:1789760741.457301:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883050112 00000100:00100000:3.0:1789760741.457358:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789760741.457367:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2462f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883050112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760741.457412:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d031c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883050624:0@lo:400:kworker.0 00000100:00100000:3.0:1789760741.457428:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2462f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883050112:12345-0@lo:400:kworker.0 Request processed in 61us (1551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760741.457436:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789760741.457465:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760741.457486:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d032300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883050240:0@lo:400:kworker.0 00000100:00100000:1.0:1789760741.457516:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258559180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883050112:0@lo:400:kworker.0 00000100:00100000:3.0:1789760741.457523:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760741.457539:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789760741.457549:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d030a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1876699883050496:0@lo:400:kworker.0 00000100:00100000:3.0:1789760741.457549:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789760741.457559:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883050368:0@lo:400:kworker.0 00000100:00100000:1.0:1789760741.457586:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760741.457603:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760741.457624:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883050624 00000100:00100000:1.0:1789760741.457629:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883050624 00000100:00100000:3.0:1789760741.457638:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883050368 00000100:00100000:3.0:1789760741.457644:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883050368 00000100:00100000:1.0:1789760741.458218:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789760741.458228:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883050624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760741.458234:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883050240 00000100:00100000:2.0:1789760741.458242:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883050240 00000100:00100000:1.0:1789760741.458272:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883050624:12345-0@lo:400:kworker.0 Request processed in 46us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760741.458278:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789760741.458297:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883050496 00000100:00100000:1.0:1789760741.458301:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883050496 00000100:00100000:0.0:1789760741.458364:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247887050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883049984:12345-0@lo:400:kworker.0 Request processed in 2329us (2671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760741.458372:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789760741.459761:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789760741.459773:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2462fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883050240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760741.459860:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2462fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883050240:12345-0@lo:400:kworker.0 Request processed in 90us (2339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760741.459867:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789760741.459911:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883049984:0@lo:400:kworker.0 00000100:00100000:2.0:1789760741.459974:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d032300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883050240:0@lo:400:kworker.0 00000100:00100000:2.0:1789760741.460025:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d031c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883050624:0@lo:400:kworker.0 00000100:00100000:3.0:1789760741.460381:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789760741.460392:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2462f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883050368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760741.460523:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2462f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883050368:12345-0@lo:400:kworker.0 Request processed in 134us (2924us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760741.460530:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789760741.460595:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883050368:0@lo:400:kworker.0 00000100:00100000:1.0:1789760741.461593:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789760741.461603:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876699883050496:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789760741.463347:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789760741.463355:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789760741.463358:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789760741.463412:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876699883050496:12345-0@lo:400:kworker.0 Request processed in 1807us (5822us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760741.463424:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789760741.463618:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d030a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1876699883050496:0@lo:400:kworker.0 00010000:00010000:3.0:1789760741.583135:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760741.969216:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2517f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883050752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760741.969295:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760741.969505:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883050752 00000100:00100000:3.0:1789760741.969513:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883050752 00000100:00100000:3.0:1789760741.969563:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789760741.969572:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883050752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789760741.969609:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760741.969662:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883050752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760741.969669:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789760741.969752:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2517f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883050752:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789760742.607157:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760743.631051:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760744.051839:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760744.051877:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760744.051911:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760744.051949:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863136512 00000100:00100000:1.0:1789760744.051950:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760744.051962:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863136512 00000100:00100000:1.0:1789760744.051981:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863136640 00000100:00100000:1.0:1789760744.051986:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863136640 00000100:00100000:3.0:1789760744.052034:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863136768 00000100:00100000:1.0:1789760744.052040:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:3.0:1789760744.052040:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863136768 00000100:00100000:1.0:1789760744.052054:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258559180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863136640:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760744.052083:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 159 00000100:00100000:3.0:1789760744.052094:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863136512:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1789760744.052191:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 160 00000100:00100000:0.0:1789760744.052197:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863136384 00000100:00100000:2.0:1789760744.052203:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2350:x1876699863136768:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1789760744.052205:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863136384 00000100:00100000:0.0:1789760744.052250:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 275 00000100:00100000:0.0:1789760744.052260:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247885450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2350:x1876699863136384:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760744.052271:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863136512:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 177us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760744.052280:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 159 00000100:00080000:3.0:1789760744.052302:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789760744.052318:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760744.052325:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258559180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863136640:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 272us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760744.052333:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:2.0:1789760744.052750:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2350:x1876699863136768:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 550us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760744.052758:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 160 00000100:00100000:0.0:1789760744.053660:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247885450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2350:x1876699863136384:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 1396us (1741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760744.053670:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 275 00010000:00010000:3.0:1789760744.655287:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760745.039125:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883050880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760745.039201:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760745.040952:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883050880 00000100:00100000:2.0:1789760745.040964:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883050880 00000100:00100000:2.0:1789760745.041040:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789760745.041051:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d329f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883050880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789760745.041091:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241893376 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760745.041168:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d329f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883050880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (1966us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760745.041174:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789760745.041222:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883050880:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789760745.041295:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789760745.679094:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760746.582389:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2517f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883051008:0@lo:400:kworker.0 00000100:00100000:2.0:1789760746.582463:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760746.582518:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2517f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1876699883051520:0@lo:400:kworker.0 00000100:00100000:2.0:1789760746.582542:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760746.582565:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789760746.582570:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2517f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876699883051136:0@lo:400:kworker.0 00000100:00100000:2.0:1789760746.582585:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760746.582598:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2517f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883051648:0@lo:400:kworker.0 00000100:00100000:2.0:1789760746.582630:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760746.582654:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2517f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883051392:0@lo:400:kworker.0 00000100:00100000:2.0:1789760746.582671:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760746.582685:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789760746.582689:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2517f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1876699883051264:0@lo:400:kworker.0 00000100:00100000:2.0:1789760746.582704:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760746.582727:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883051520 00000100:00100000:2.0:1789760746.582733:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883051520 00000100:00100000:2.0:1789760746.582777:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883051136 00000100:00100000:2.0:1789760746.582780:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883051136 00000100:00100000:2.0:1789760746.582791:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883051264 00000100:00100000:2.0:1789760746.582793:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883051264 00000100:00100000:2.0:1789760746.582829:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789760746.582838:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876699883051520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760746.582889:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876699883051520:12345-0@lo:400:kworker.0 Request processed in 51us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760746.582895:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789760746.582910:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789760746.582915:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876699883051136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760746.582951:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876699883051136:12345-0@lo:400:kworker.0 Request processed in 35us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760746.582956:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789760746.582965:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789760746.582970:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d031c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876699883051264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760746.582991:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d031c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876699883051264:12345-0@lo:400:kworker.0 Request processed in 21us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760746.582996:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789760746.583018:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883051648 00000100:00100000:2.0:1789760746.583021:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883051648 00000100:00100000:2.0:1789760746.583041:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883051392 00000100:00100000:2.0:1789760746.583043:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883051392 00000100:00100000:2.0:1789760746.583057:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789760746.583062:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883051648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760746.583146:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883051648:12345-0@lo:400:kworker.0 Request processed in 84us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760746.583153:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789760746.583163:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789760746.583169:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d033800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883051392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760746.583194:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d033800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883051392:12345-0@lo:400:kworker.0 Request processed in 26us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760746.583199:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1789760746.583217:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789760746.583221:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760746.583249:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2517f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1876699883051264:0@lo:400:kworker.0 00000100:00100000:2.0:1789760746.583258:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2517f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883051392:0@lo:400:kworker.0 00000100:00100000:2.0:1789760746.583284:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2517f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876699883051136:0@lo:400:kworker.0 00000100:00100000:2.0:1789760746.583304:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2517f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883051648:0@lo:400:kworker.0 00000100:00100000:2.0:1789760746.583312:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2517f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1876699883051520:0@lo:400:kworker.0 00000100:00100000:0.0:1789760746.583569:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883051008 00000100:00100000:0.0:1789760746.583573:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883051008 00000100:00100000:0.0:1789760746.583609:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1789760746.583617:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247887850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883051008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760746.583656:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247887850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883051008:12345-0@lo:400:kworker.0 Request processed in 39us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760746.583662:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789760746.584107:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2517f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883051008:0@lo:400:kworker.0 00010000:00010000:1.0:1789760746.704369:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760747.090616:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2517f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883051776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760747.090686:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760747.091106:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883051776 00000100:00100000:1.0:1789760747.091116:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883051776 00000100:00100000:1.0:1789760747.091164:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789760747.091173:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d032300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883051776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789760747.091209:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760747.091261:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d032300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883051776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760747.091268:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789760747.092253:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2517f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883051776:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789760747.729467:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760748.751096:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760749.171993:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760749.172049:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760749.172081:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863136896 00000100:00100000:2.0:1789760749.172085:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863137024 00000100:00100000:0.0:1789760749.172091:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863136896 00000100:00100000:2.0:1789760749.172092:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863137024 00000100:00100000:0.0:1789760749.172153:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 277 00000100:00100000:2.0:1789760749.172153:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 164 00000100:00100000:0.0:1789760749.172166:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247884c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2351:x1876699863136896:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1789760749.172169:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2517f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863137024:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1789760749.172251:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247884c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2351:x1876699863136896:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 84us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760749.172252:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2517f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863137024:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 84us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760749.172280:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 164 00000100:00100000:0.0:1789760749.172283:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 277 00000100:00080000:2.0:1789760749.172316:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760749.178142:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760749.178189:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760749.178287:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863137280 00000100:00100000:2.0:1789760749.178696:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863137280 00000100:00100000:2.0:1789760749.178828:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 165 00000100:00100000:2.0:1789760749.178840:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2517f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2350:x1876699863137280:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1789760749.178924:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2517f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2350:x1876699863137280:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 86us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760749.178932:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 165 00000100:00100000:2.0:1789760749.178959:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863137152 00000100:00100000:2.0:1789760749.178964:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863137152 00000100:00080000:3.0:1789760749.179301:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789760749.179306:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760749.179460:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:2.0:1789760749.179468:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2517f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2347:x1876699863137152:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:2.0:1789760749.179545:0:6693:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e099f5ef04adee3 00000100:00080000:2.0:1789760749.179555:0:6693:0:(import.c:65:import_set_state_nolock()) ffff8df26d414000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789760749.179582:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1789760749.179598:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967425 00000100:00100000:2.0:1789760749.179857:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2517f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+2:2347:x1876699863137152:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 388us (1666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760749.179866:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 57 00000001:00100000:2.0:1789760749.234312:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1da0113a-370d-4d79-883c-54efc174697f 00000020:00000080:2.0:1789760749.234327:0:6719:0:(genops.c:885:class_export_put()) final put ffff8df1411e6000/1da0113a-370d-4d79-883c-54efc174697f 00000020:00000080:1.0:1789760749.234458:0:477:0:(genops.c:844:class_export_destroy()) destroying export ffff8df1411e6000/1da0113a-370d-4d79-883c-54efc174697f for lustre-OST0000 00000020:00000080:1.0:1789760749.234503:0:477:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df26d414000 for lustre-OST0000 00000100:00100000:3.0:1789760749.731475:0:12398:0:(nrs_tbf.c:480:nrs_tbf_cli_fini()) ost_io.0 NRS: TBF class fini: class@ffff8df26d6e5800 key uid={0} rule@0xffff8df258e6dc00 gen 0 rate 10000 depth 3 token 2 deadline 288133093960 time 289721099093 state 0x6 ref 0 00000100:00100000:3.0:1789760749.731495:0:12398:0:(nrs_tbf.c:480:nrs_tbf_cli_fini()) ost_io.0 NRS: TBF class fini: class@ffff8df258fc0c00 key uid={500} rule@0xffff8df258e6d000 gen 0 rate 5 depth 3 token 0 deadline 331301949436 time 331302045193 state 0x6 ref 0 00000100:00100000:3.0:1789760749.735934:0:12398:0:(nrs_tbf.c:480:nrs_tbf_cli_fini()) ost_io.0 NRS: TBF class fini: class@ffff8df26d322e00 key uid={0} rule@0xffff8df258e6d100 gen 0 rate 10000 depth 3 token 2 deadline 287982368333 time 287982568239 state 0x6 ref 0 00010000:00010000:2.0:1789760749.775929:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760750.159717:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789760750.159740:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2462f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883051904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789760750.159860:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760750.160110:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883051904 00000100:00100000:1.0:1789760750.160119:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883051904 00000100:00100000:1.0:1789760750.160185:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789760750.160195:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2517f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883051904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789760750.160231:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760750.160295:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2517f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883051904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760750.160302:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1789760750.160453:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760750.160534:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2462f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883051904:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789760750.802097:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760751.695138:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2462fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883052288:0@lo:400:kworker.0 00000100:00100000:1.0:1789760751.695223:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760751.695337:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2462fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883052032:0@lo:400:kworker.0 00000100:00100000:2.0:1789760751.695369:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760751.695397:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789760751.695402:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2462f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876699883052160:0@lo:400:kworker.0 00000100:00100000:2.0:1789760751.695421:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760751.695446:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883052032 00000100:00100000:2.0:1789760751.695451:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883052032 00000100:00100000:2.0:1789760751.695493:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789760751.695501:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247885050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883052032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760751.695540:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247885050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883052032:12345-0@lo:400:kworker.0 Request processed in 40us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760751.695547:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789760751.695575:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883052288 00000100:00100000:2.0:1789760751.695577:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883052288 00000100:00100000:2.0:1789760751.695604:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883052160 00000100:00100000:2.0:1789760751.695606:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883052160 00000100:00100000:2.0:1789760751.695619:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789760751.695625:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d32b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883052288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760751.695923:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789760751.695932:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876699883052160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760751.695962:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876699883052160:12345-0@lo:400:kworker.0 Request processed in 33us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760751.695969:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789760751.695985:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2462f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883052416:0@lo:400:kworker.0 00000100:00100000:0.0:1789760751.696013:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760751.696040:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883052416 00000100:00100000:0.0:1789760751.696044:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883052416 00000100:00100000:0.0:1789760751.696069:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789760751.696075:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2517f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883052416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760751.696117:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2517f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883052416:12345-0@lo:400:kworker.0 Request processed in 42us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760751.696123:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:0.0:1789760751.696148:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760751.696174:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2462f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883052416:0@lo:400:kworker.0 00000100:00100000:0.0:1789760751.696207:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2462f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876699883052160:0@lo:400:kworker.0 00000100:00100000:0.0:1789760751.696215:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2462fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883052032:0@lo:400:kworker.0 00000100:00100000:2.0:1789760751.696674:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d32b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883052288:12345-0@lo:400:kworker.0 Request processed in 1046us (1448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760751.696690:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789760751.696964:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2462fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1876699883052544:0@lo:400:kworker.0 00000100:00100000:0.0:1789760751.696992:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760751.697072:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883052544 00000100:00100000:2.0:1789760751.697076:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883052544 00000100:00100000:2.0:1789760751.697121:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789760751.697127:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2517f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876699883052544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760751.697296:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2462fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883052288:0@lo:400:kworker.0 00000100:00080000:1.0:1789760751.697329:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760751.697341:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2462f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883052672:0@lo:400:kworker.0 00000100:00100000:1.0:1789760751.697364:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760751.697388:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883052672 00000100:00100000:1.0:1789760751.697391:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883052672 00000100:00100000:1.0:1789760751.697416:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789760751.697422:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d32b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883052672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760751.697451:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d32b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883052672:12345-0@lo:400:kworker.0 Request processed in 29us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760751.697456:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1789760751.697471:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789760751.697484:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2462f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883052672:0@lo:400:kworker.0 00000100:00100000:2.0:1789760751.704330:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2517f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876699883052544:12345-0@lo:400:kworker.0 Request processed in 7193us (7327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760751.704344:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789760751.704470:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2462fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1876699883052544:0@lo:400:kworker.0 00010000:00010000:1.0:1789760751.823037:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760752.207233:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789760752.207273:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df251669c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883052800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760752.207345:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760752.208214:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883052800 00000100:00100000:3.0:1789760752.208225:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883052800 00000100:00100000:3.0:1789760752.208293:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789760752.208785:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883052800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789760752.208864:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760752.209003:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883052800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 701us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760752.209012:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789760752.212986:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df251669c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883052800:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789760752.847003:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760753.812995:0:12447:0:(nrs_tbf.c:546:nrs_tbf_rule_start()) TBF starts rule@ffff8df274bf2500 rate 10000 gen 0 00000100:00100000:2.0:1789760753.813037:0:12447:0:(nrs_tbf.c:546:nrs_tbf_rule_start()) TBF starts rule@ffff8df274bf2100 rate 10000 gen 0 00000100:00100000:2.0:1789760753.813780:0:12447:0:(nrs_tbf.c:546:nrs_tbf_rule_start()) TBF starts rule@ffff8df274bf2f00 rate 5 gen 0 00000100:00100000:2.0:1789760753.813789:0:12447:0:(nrs_tbf.c:546:nrs_tbf_rule_start()) TBF starts rule@ffff8df274bf2c00 rate 5 gen 0 00000100:00100000:2.0:1789760753.851994:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760753.853716:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863137408 00000100:00100000:3.0:1789760753.853726:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863137408 00000100:00100000:3.0:1789760753.853794:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:3.0:1789760753.853819:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+5:11029:x1876699863137408:12345-192.168.203.12@tcp:101:mkdir.0 00010000:00010000:3.0:1789760753.853839:0:7279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760753.853861:0:7279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfa00/0x3e099f5ef04ae859 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d1c6 expref: -99 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.853922:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbec00/0x3e099f5ef04ae860 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.853934:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbec00/0x3e099f5ef04ae860 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.853948:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbec00/0x3e099f5ef04ae860 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760753.854004:0:7279:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789760753.854007:0:7279:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789760753.854025:0:7279:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbec00/0x3e099f5ef04ae860 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.854050:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfa00/0x3e099f5ef04ae859 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1c6 expref: 7 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789760753.854327:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789760753.861723:0:7279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbec00/0x3e099f5ef04ae860 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1c6 expref: 6 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.861740:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df245dcc000) 00010000:00010000:3.0:1789760753.861743:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789760753.861747:0:7279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df277dbec00, rc 0) 00000100:00100000:3.0:1789760753.861843:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+6:11029:x1876699863137408:12345-192.168.203.12@tcp:101:mkdir.0 Request processed in 8039us (9857us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760753.861853:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:3.0:1789760753.867459:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760753.867526:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863137536 00000100:00100000:0.0:1789760753.867535:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863137536 00000100:00100000:0.0:1789760753.867598:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:0.0:1789760753.867608:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2462f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863137536:12345-192.168.203.12@tcp:41:mkdir.0 00000004:00000024:0.0:1789760753.867650:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789760753.867715:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2462f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863137536:12345-192.168.203.12@tcp:41:mkdir.0 Request processed in 109us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760753.867723:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:0.0:1789760753.869722:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760753.869793:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863137792 00000100:00100000:3.0:1789760753.869822:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863137792 00000100:00100000:3.0:1789760753.869870:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:3.0:1789760753.869880:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df251669500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+6:11029:x1876699863137792:12345-192.168.203.12@tcp:36:mkdir.0 00010000:00010000:3.0:1789760753.869934:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760753.869961:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbec00/0x3e099f5ef04ae860 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1c6 expref: 6 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.869979:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df245dcc000) 00010000:00010000:3.0:1789760753.869998:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789760753.870209:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae867 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.870223:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae867 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.870242:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae867 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.870254:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf200/0x3e099f5ef04ae86e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.870261:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf200/0x3e099f5ef04ae86e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.870268:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf200/0x3e099f5ef04ae86e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760753.871160:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 16384 00010000:00010000:3.0:1789760753.871172:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae867 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.871180:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae867 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.871186:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae867 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.871192:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df277dbfe00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760753.871196:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae867 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.871214:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae867 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.871226:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df245dcc800) 00010000:00010000:3.0:1789760753.871228:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760753.871232:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae867 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.871270:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae867 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760753.871287:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c299adc reply state 00000000670978d0 transno 4294967363 ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf200/0x3e099f5ef04ae86e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760753.871294:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789760753.871380:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df251669500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+7:11029:x1876699863137792:12345-192.168.203.12@tcp:36:mkdir.0 Request processed in 1500us (1663us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1789760753.871389:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 94 00010000:00010000:3.0:1789760753.876149:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf200/0x3e099f5ef04ae86e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.876167:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf200/0x3e099f5ef04ae86e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.876175:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf200/0x3e099f5ef04ae86e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.876181:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df277dbf200 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760753.876186:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf200/0x3e099f5ef04ae86e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.876212:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf200/0x3e099f5ef04ae86e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.876226:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff8df245dcca00) 00010000:00010000:3.0:1789760753.876229:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760753.876247:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf200/0x3e099f5ef04ae86e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.876254:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf200/0x3e099f5ef04ae86e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760753.876377:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760753.898466:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760753.903932:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863137920 00000100:00100000:0.0:1789760753.903947:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863137920 00000100:00100000:0.0:1789760753.904003:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:0.0:1789760753.904013:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+6:11030:x1876699863137920:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1789760753.904035:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760753.904057:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae875 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d1cd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.904119:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ae87c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.904141:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ae87c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.904154:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ae87c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760753.904189:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789760753.904197:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789760753.904218:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ae87c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.904252:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae875 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1cd expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.904265:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ae87c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1cd expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.904273:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df2502f3100) 00010000:00010000:0.0:1789760753.904276:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789760753.904280:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2778e9200, rc 0) 00000100:00100000:0.0:1789760753.904550:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+7:11030:x1876699863137920:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 537us (6092us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760753.904558:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:0.0:1789760753.909908:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760753.909983:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863138176 00000100:00100000:3.0:1789760753.909994:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863138176 00000100:00100000:3.0:1789760753.910049:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 96 00000100:00100000:3.0:1789760753.910059:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df251669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+7:11030:x1876699863138176:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1789760753.910080:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760753.910083:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789760753.910108:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ae87c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1cd expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910123:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df2502f3100) 00010000:00010000:3.0:1789760753.910134:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789760753.910148:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf200/0x3e099f5ef04ae883 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d1d4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910390:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae88a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910403:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae88a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910421:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae88a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910435:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbec00/0x3e099f5ef04ae891 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910441:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbec00/0x3e099f5ef04ae891 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910448:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbec00/0x3e099f5ef04ae891 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910525:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe400/0x3e099f5ef04ae898 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910533:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe400/0x3e099f5ef04ae898 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910540:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe400/0x3e099f5ef04ae898 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760753.910548:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 16384 00010000:00010000:3.0:1789760753.910558:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe400/0x3e099f5ef04ae898 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910565:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe400/0x3e099f5ef04ae898 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910572:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe400/0x3e099f5ef04ae898 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910577:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df277dbe400 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760753.910587:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe400/0x3e099f5ef04ae898 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910594:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe400/0x3e099f5ef04ae898 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910603:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df245dcc000) 00010000:00010000:3.0:1789760753.910606:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760753.910609:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe400/0x3e099f5ef04ae898 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910615:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe400/0x3e099f5ef04ae898 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910630:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae88a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910636:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae88a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910642:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae88a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910647:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df277dbfe00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760753.910650:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae88a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910656:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae88a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910663:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df245dcca00) 00010000:00010000:3.0:1789760753.910665:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760753.910673:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae88a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910679:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae88a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910687:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbec00/0x3e099f5ef04ae891 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910694:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbec00/0x3e099f5ef04ae891 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910700:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbec00/0x3e099f5ef04ae891 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910705:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df277dbec00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760753.910708:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbec00/0x3e099f5ef04ae891 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910714:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbec00/0x3e099f5ef04ae891 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910721:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff8df245dcc800) 00010000:00010000:3.0:1789760753.910723:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760753.910726:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbec00/0x3e099f5ef04ae891 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910731:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbec00/0x3e099f5ef04ae891 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910755:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf200/0x3e099f5ef04ae883 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1d4 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910774:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df245dcca00) 00010000:00010000:3.0:1789760753.910776:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760753.910781:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf200/0x3e099f5ef04ae883 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1d4 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.910791:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df277dbf200, rc 0) 00000100:00100000:3.0:1789760753.910881:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df251669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+6:11030:x1876699863138176:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 823us (982us total) trans 0 rc 301/301 00000100:00100000:3.0:1789760753.910889:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 96 00000100:00100000:3.0:1789760753.914790:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760753.914854:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863138304 00000100:00100000:3.0:1789760753.914865:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863138304 00000100:00100000:3.0:1789760753.914919:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:3.0:1789760753.914930:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2462f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+6:11030:x1876699863138304:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1789760753.914949:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760753.914972:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfa00/0x3e099f5ef04ae89f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d1db expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.915040:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe800/0x3e099f5ef04ae8a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.915056:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe800/0x3e099f5ef04ae8a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.915068:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe800/0x3e099f5ef04ae8a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760753.915121:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789760753.915125:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789760753.915143:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe800/0x3e099f5ef04ae8a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.915169:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfa00/0x3e099f5ef04ae89f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1db expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.915188:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe800/0x3e099f5ef04ae8a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1db expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.915196:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df245dcc300) 00010000:00010000:3.0:1789760753.915199:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789760753.915203:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df277dbe800, rc 0) 00000100:00100000:3.0:1789760753.915264:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2462f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+7:11030:x1876699863138304:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 335us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760753.915270:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:3.0:1789760753.923577:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760753.924457:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863138560 00000100:00100000:0.0:1789760753.924468:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863138560 00000100:00100000:0.0:1789760753.924523:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:0.0:1789760753.924532:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2462fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+7:11030:x1876699863138560:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1789760753.924559:0:7279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760753.924579:0:7279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04ae8ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d1e2 expref: -99 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.924649:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ae8b4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.924664:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ae8b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.924674:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ae8b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.924690:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae8bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.924696:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae8bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.924703:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae8bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760753.924822:0:7279:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 16384 00010000:00010000:0.0:1789760753.924909:0:7279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ae8b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.924918:0:7279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ae8b4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.924925:0:7279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ae8b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.924941:0:7279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2778e8c00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760753.924946:0:7279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ae8b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.924955:0:7279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ae8b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.924966:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df245dcc300) 00010000:00010000:0.0:1789760753.924969:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760753.924973:0:7279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ae8b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.924980:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ae8b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.924991:0:7279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae8bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.924997:0:7279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae8bb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.925003:0:7279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae8bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.925007:0:7279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2778e9a00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760753.925010:0:7279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae8bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.925016:0:7279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae8bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.925035:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff8df2502f3f00) 00010000:00010000:0.0:1789760753.925037:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760753.925040:0:7279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae8bb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.925047:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae8bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.925082:0:7279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04ae8ad lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1e2 expref: 9 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.925092:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df245dcc300) 00010000:00010000:0.0:1789760753.925094:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789760753.925097:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04ae8ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1e2 expref: 9 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.925106:0:7279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2778e8a00, rc 0) 00000100:00100000:0.0:1789760753.925163:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2462fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+8:11030:x1876699863138560:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 632us (1599us total) trans 4294967364 rc 301/301 00000100:00100000:0.0:1789760753.925171:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:3.0:1789760753.928592:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760753.928678:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863138816 00000100:00100000:0.0:1789760753.928688:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863138816 00000100:00100000:0.0:1789760753.928742:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 99 00000100:00100000:0.0:1789760753.928751:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2462f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+8:11030:x1876699863138816:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:0.0:1789760753.928854:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ae8c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.928870:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ae8c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.928889:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ae8c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789760753.929074:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001fd8febe reply state 00000000f345efdd transno 4294967365 ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ae8c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760753.929084:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789760753.929092:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 16384 00000100:00100000:0.0:1789760753.929161:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2462f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+10:11030:x1876699863138816:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 410us (579us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1789760753.929168:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 99 00000100:00100000:2.0:1789760753.933374:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00010000:00010000:3.0:1789760753.933375:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ae8c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.933386:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ae8c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.933394:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ae8c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.933400:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2778e9200 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760753.933412:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ae8c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.933420:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ae8c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.933441:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df2502f3d00) 00010000:00010000:3.0:1789760753.933444:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789760753.933448:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ae8c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.933454:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ae8c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760753.933498:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863139072 00000100:00100000:0.0:1789760753.933508:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863139072 00000100:00100000:0.0:1789760753.933563:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:0.0:1789760753.933573:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+10:11030:x1876699863139072:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1789760753.935349:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+10:11030:x1876699863139072:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 1770us (1976us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1789760753.935361:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:2.0:1789760753.947447:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760753.947749:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863139200 00000100:00100000:1.0:1789760753.947759:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863139200 00000100:00100000:1.0:1789760753.947832:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:1.0:1789760753.947842:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+10:11031:x1876699863139200:12345-192.168.203.12@tcp:101:chmod.0 00010000:00010000:1.0:1789760753.947864:0:7279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760753.947885:0:7279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f200/0x3e099f5ef04ae8d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d1e9 expref: -99 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.947953:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e800/0x3e099f5ef04ae8d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.947967:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e800/0x3e099f5ef04ae8d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.947978:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e800/0x3e099f5ef04ae8d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.947993:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f400/0x3e099f5ef04ae8de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.947999:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f400/0x3e099f5ef04ae8de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.948006:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f400/0x3e099f5ef04ae8de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.948319:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e600/0x3e099f5ef04ae8e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.948329:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e600/0x3e099f5ef04ae8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.948337:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e600/0x3e099f5ef04ae8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789760753.948517:0:7279:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 16384 00000004:00200000:1.0:1789760753.948522:0:7279:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789760753.948546:0:7279:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e600/0x3e099f5ef04ae8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.948569:0:7279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e800/0x3e099f5ef04ae8d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.948576:0:7279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e800/0x3e099f5ef04ae8d7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.948582:0:7279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e800/0x3e099f5ef04ae8d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.948589:0:7279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861e800 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:1.0:1789760753.948594:0:7279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e800/0x3e099f5ef04ae8d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.948602:0:7279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e800/0x3e099f5ef04ae8d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.948616:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df245dcc300) 00010000:00010000:1.0:1789760753.948619:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760753.948623:0:7279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e800/0x3e099f5ef04ae8d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.948629:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e800/0x3e099f5ef04ae8d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.948643:0:7279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f400/0x3e099f5ef04ae8de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.948649:0:7279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f400/0x3e099f5ef04ae8de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.948655:0:7279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f400/0x3e099f5ef04ae8de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.948666:0:7279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861f400 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:1.0:1789760753.948669:0:7279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f400/0x3e099f5ef04ae8de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.948675:0:7279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f400/0x3e099f5ef04ae8de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.948684:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff8df25b60df00) 00010000:00010000:1.0:1789760753.948686:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760753.948689:0:7279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f400/0x3e099f5ef04ae8de lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.948695:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f400/0x3e099f5ef04ae8de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.948726:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f200/0x3e099f5ef04ae8d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1e9 expref: 12 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.948740:0:7279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e600/0x3e099f5ef04ae8e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1e9 expref: 11 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760753.948747:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df25b60dd00) 00010000:00010000:1.0:1789760753.948750:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789760753.948752:0:7279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df25861e600, rc 0) 00000100:00100000:1.0:1789760753.948833:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+11:11031:x1876699863139200:12345-192.168.203.12@tcp:101:chmod.0 Request processed in 991us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760753.948841:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:3.0:1789760753.953678:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760753.953719:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863139456 00000100:00100000:3.0:1789760753.953729:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863139456 00000100:00100000:3.0:1789760753.953786:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 101 00000100:00100000:3.0:1789760753.953879:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2462fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+11:11031:x1876699863139456:12345-192.168.203.12@tcp:36:chmod.0 00010000:00010000:3.0:1789760753.953943:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760753.954187:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e600/0x3e099f5ef04ae8e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1e9 expref: 11 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.954207:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df25b60dd00) 00010000:00010000:3.0:1789760753.954216:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789760753.954251:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf800/0x3e099f5ef04ae8ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.954327:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf800/0x3e099f5ef04ae8ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760753.954349:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf800/0x3e099f5ef04ae8ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760753.954930:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000094c2ae5b reply state 00000000695b701b transno 4294967367 ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf800/0x3e099f5ef04ae8ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760753.954941:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789760753.955065:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 16384 00000100:00100000:3.0:1789760753.955223:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2462fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+12:11031:x1876699863139456:12345-192.168.203.12@tcp:36:chmod.0 Request processed in 1427us (1552us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1789760753.955241:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 101 00010000:00010000:0.0:1789760753.961000:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf800/0x3e099f5ef04ae8ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.961018:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf800/0x3e099f5ef04ae8ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.961026:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf800/0x3e099f5ef04ae8ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.961033:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df277dbf800 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760753.961038:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf800/0x3e099f5ef04ae8ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.961047:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf800/0x3e099f5ef04ae8ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.961311:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df245dcca00) 00010000:00010000:0.0:1789760753.961314:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789760753.961320:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf800/0x3e099f5ef04ae8ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760753.961327:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf800/0x3e099f5ef04ae8ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760754.010683:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760754.010836:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863139584 00000100:00100000:0.0:1789760754.010847:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863139584 00000100:00100000:0.0:1789760754.010907:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 102 00000100:00100000:0.0:1789760754.010917:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df142e40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+11:11035:x1876699863139584:12345-192.168.203.12@tcp:101:touch.500 00010000:00010000:0.0:1789760754.010940:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760754.010962:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04ae8f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d1f0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.011024:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae8fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.011037:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae8fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.011047:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae8fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.011063:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ae901 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.011070:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ae901 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.011093:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ae901 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.011197:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ae908 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.011207:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ae908 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.011214:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ae908 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760754.011246:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 16384 00000004:00200000:0.0:1789760754.011250:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789760754.011269:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ae908 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.011281:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae8fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.011287:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae8fa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.011303:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae8fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.011309:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2778e9a00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760754.011313:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae8fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.011321:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae8fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.011340:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df245dcc300) 00010000:00010000:0.0:1789760754.011344:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760754.011348:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae8fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.011355:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae8fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.011369:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ae901 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.011376:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ae901 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.011382:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ae901 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.011388:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2778e8c00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760754.011391:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ae901 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.011396:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ae901 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.011403:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff8df2502f3f00) 00010000:00010000:0.0:1789760754.011406:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760754.011408:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ae901 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.011414:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ae901 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.011453:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04ae8f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1f0 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.011467:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ae908 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1f0 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.011475:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df2502f3500) 00010000:00010000:0.0:1789760754.011477:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789760754.011479:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2778e9200, rc 0) 00000100:00100000:0.0:1789760754.011541:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df142e40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+12:11035:x1876699863139584:12345-192.168.203.12@tcp:101:touch.500 Request processed in 625us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760754.011548:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 102 00000100:00100000:0.0:1789760754.019946:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760754.020165:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863139840 00000100:00100000:2.0:1789760754.020175:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863139840 00000100:00100000:2.0:1789760754.020246:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 103 00000100:00100000:2.0:1789760754.020257:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df251669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+12:11035:x1876699863139840:12345-192.168.203.12@tcp:101:touch.500 00010000:00010000:2.0:1789760754.020276:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760754.020297:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2800/0x3e099f5ef04ae90f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d1f7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.020537:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04ae916 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.020553:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04ae916 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.020578:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04ae916 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.020613:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2200/0x3e099f5ef04ae91d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.020621:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2200/0x3e099f5ef04ae91d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.020628:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2200/0x3e099f5ef04ae91d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789760754.021725:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00000004:00080000:2.0:1789760754.021735:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1789760754.021943:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3400/0x3e099f5ef04ae924 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.021957:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3400/0x3e099f5ef04ae924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.021966:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3400/0x3e099f5ef04ae924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.021999:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04ae916 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.022006:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04ae916 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.022012:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04ae916 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.022031:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3800 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760754.022035:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04ae916 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.022043:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04ae916 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.022056:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df2502f3500) 00010000:00010000:2.0:1789760754.022059:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760754.022063:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04ae916 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.022069:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04ae916 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760754.022081:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d70ecae reply state 00000000840bb185 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2200/0x3e099f5ef04ae91d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760754.022130:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789760754.022163:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2800/0x3e099f5ef04ae90f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1f7 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.022177:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3400/0x3e099f5ef04ae924 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1f7 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.022189:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff8df250325d00) 00010000:00010000:2.0:1789760754.022191:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789760754.022194:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2517f3400, rc 0) 00000100:00100000:2.0:1789760754.022273:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df251669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+15:11035:x1876699863139840:12345-192.168.203.12@tcp:101:touch.500 Request processed in 2017us (2334us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1789760754.022296:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 103 00010000:00010000:2.0:1789760754.024428:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2200/0x3e099f5ef04ae91d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.024442:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2200/0x3e099f5ef04ae91d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.024451:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2200/0x3e099f5ef04ae91d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.024457:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2200 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760754.024461:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2200/0x3e099f5ef04ae91d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.024469:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2200/0x3e099f5ef04ae91d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.024486:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0xe7cddcd6 (ffff8df250325f00) 00010000:00010000:2.0:1789760754.024488:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760754.024492:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2200/0x3e099f5ef04ae91d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.024498:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2200/0x3e099f5ef04ae91d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760754.036079:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760754.036344:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863140096 00000100:00100000:0.0:1789760754.036355:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863140096 00000100:00100000:0.0:1789760754.036413:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:0.0:1789760754.036425:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+14:11035:x1876699863140096:12345-192.168.203.12@tcp:36:touch.500 00010000:00010000:0.0:1789760754.036492:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760754.036518:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3400/0x3e099f5ef04ae924 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1f7 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.036539:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff8df250325d00) 00010000:00010000:0.0:1789760754.036552:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760754.036595:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04ae932 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.036610:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04ae932 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.036628:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04ae932 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789760754.036756:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002665a599 reply state 000000000eb6c487 transno 4294967369 ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04ae932 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760754.036766:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789760754.037061:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+15:11035:x1876699863140096:12345-192.168.203.12@tcp:36:touch.500 Request processed in 637us (991us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1789760754.037070:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 104 00010000:00010000:0.0:1789760754.041885:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04ae932 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.041902:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04ae932 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.041910:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04ae932 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.041916:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2778e8a00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760754.041921:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04ae932 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.041929:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04ae932 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.041945:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff8df2502f3f00) 00010000:00010000:0.0:1789760754.041948:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760754.041953:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04ae932 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.041976:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04ae932 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760754.042298:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760754.042582:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863140224 00000100:00100000:3.0:1789760754.042593:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863140224 00000100:00100000:3.0:1789760754.042651:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 105 00000100:00100000:3.0:1789760754.042661:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+14:11035:x1876699863140224:12345-192.168.203.12@tcp:101:touch.500 00010000:00010000:3.0:1789760754.042682:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760754.042699:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfa00/0x3e099f5ef04ae939 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d1fe expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.042757:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfa00/0x3e099f5ef04ae939 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1fe expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.042771:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfa00/0x3e099f5ef04ae939 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1fe expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.042786:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff8df245dcc800) 00010000:00010000:3.0:1789760754.042795:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789760754.042816:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df277dbfa00, rc 0) 00000100:00100000:3.0:1789760754.042870:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+15:11035:x1876699863140224:12345-192.168.203.12@tcp:101:touch.500 Request processed in 210us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760754.042877:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 105 00000100:00100000:3.0:1789760754.047670:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760754.047713:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760754.048422:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863140352 00000100:00100000:2.0:1789760754.048432:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863140352 00000100:00100000:2.0:1789760754.048955:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863140608 00000100:00100000:2.0:1789760754.048960:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863140608 00000100:00100000:1.0:1789760754.050069:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:1.0:1789760754.050080:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df142e40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1876699863140352:12345-192.168.203.12@tcp:8:touch.500 00010000:00080000:1.0:1789760754.050116:0:6694:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp t0 exp 0000000000000000 cur 358 last 0 00000020:00000080:1.0:1789760754.050149:0:6694:0:(genops.c:1385:class_connect()) connect: client 1da0113a-370d-4d79-883c-54efc174697f, cookie 0x3e099f5ef04ae940 00002000:00100000:1.0:1789760754.050162:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1da0113a-370d-4d79-883c-54efc174697f/ffff8df27ca31000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 201064448 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789760754.050185:0:6694:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789760754.050421:0:6694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789760754.050460:0:6694:0:(import.c:65:import_set_state_nolock()) ffff8df27ca35800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789760754.050532:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df142e40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2347:x1876699863140352:12345-192.168.203.12@tcp:8:touch.500 Request processed in 449us (2868us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760754.050540:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:1.0:1789760754.050684:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:1.0:1789760754.050694:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df142e43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1876699863140608:12345-192.168.203.12@tcp:8:touch.500 00010000:00080000:1.0:1789760754.050713:0:6694:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp t0 exp 0000000000000000 cur 358 last 0 00000020:00000080:1.0:1789760754.050733:0:6694:0:(genops.c:1385:class_connect()) connect: client 1da0113a-370d-4d79-883c-54efc174697f, cookie 0x3e099f5ef04ae947 00002000:00100000:1.0:1789760754.050739:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1da0113a-370d-4d79-883c-54efc174697f/ffff8df27ca36000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 30670848 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789760754.050754:0:6694:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789760754.051225:0:6694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789760754.051251:0:6694:0:(import.c:65:import_set_state_nolock()) ffff8df27ca35000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789760754.051323:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df142e43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2347:x1876699863140608:12345-192.168.203.12@tcp:8:touch.500 Request processed in 628us (3608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760754.051330:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:2.0:1789760754.058466:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760754.058522:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760754.058628:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863140480 00000100:00100000:1.0:1789760754.058643:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863140480 00000100:00100000:1.0:1789760754.058726:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863140736 00000100:00100000:1.0:1789760754.058729:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863140736 00000100:00100000:1.0:1789760754.058755:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:1.0:1789760754.058763:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+6:0:x1876699863140480:12345-192.168.203.12@tcp:2:touch.500 00000100:00100000:1.0:1789760754.059326:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:1.0:1789760754.059335:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+6:0:x1876699863140736:12345-192.168.203.12@tcp:2:touch.500 00000100:00080000:2.0:1789760754.060362:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789760754.060369:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760754.098518:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+7:0:x1876699863140480:12345-192.168.203.12@tcp:2:touch.500 Request processed in 39744us (40050us total) trans 4294967426 rc 0/0 00000100:00100000:3.0:1789760754.098533:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00000001:00080000:2.0:1789760754.099845:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967426 is committed 00000001:00100000:2.0:1789760754.099858:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1da0113a-370d-4d79-883c-54efc174697f 00000001:00080000:2.0:1789760754.103341:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00100000:2.0:1789760754.103355:0:7658:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1da0113a-370d-4d79-883c-54efc174697f 00000100:00100000:1.0:1789760754.103622:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+5:0:x1876699863140736:12345-192.168.203.12@tcp:2:touch.500 Request processed in 44282us (45093us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1789760754.103633:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:2.0:1789760754.109002:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760754.109079:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863140992 00000100:00100000:1.0:1789760754.109091:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863140992 00000100:00100000:1.0:1789760754.109161:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:1.0:1789760754.109173:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+15:11035:x1876699863140992:12345-192.168.203.12@tcp:35:touch.500 00000100:00100000:1.0:1789760754.109537:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+16:11035:x1876699863140992:12345-192.168.203.12@tcp:35:touch.500 Request processed in 366us (544us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1789760754.109544:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:0.0:1789760754.156383:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760754.158247:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863141248 00000100:00100000:1.0:1789760754.158262:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863141248 00000100:00100000:2.0:1789760754.158458:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 106 00000100:00100000:2.0:1789760754.158470:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df251668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+16:11039:x1876699863141248:12345-192.168.203.12@tcp:101:touch.500 00010000:00010000:2.0:1789760754.158493:0:7279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760754.158514:0:7279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2200/0x3e099f5ef04ae94e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d205 expref: -99 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.158642:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2800/0x3e099f5ef04ae955 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.158656:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2800/0x3e099f5ef04ae955 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.158668:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2800/0x3e099f5ef04ae955 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.158728:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04ae95c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.158736:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04ae95c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.158743:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04ae95c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789760754.159241:0:7279:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00000004:00080000:2.0:1789760754.159252:0:7279:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1789760754.159408:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2600/0x3e099f5ef04ae963 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.159418:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2600/0x3e099f5ef04ae963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.159426:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2600/0x3e099f5ef04ae963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.159458:0:7279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2800/0x3e099f5ef04ae955 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.159466:0:7279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2800/0x3e099f5ef04ae955 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.159472:0:7279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2800/0x3e099f5ef04ae955 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.159478:0:7279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2800 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760754.159483:0:7279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2800/0x3e099f5ef04ae955 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.159490:0:7279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2800/0x3e099f5ef04ae955 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.159501:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df2502f3500) 00010000:00010000:2.0:1789760754.159504:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760754.159509:0:7279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2800/0x3e099f5ef04ae955 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.159522:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2800/0x3e099f5ef04ae955 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760754.159535:0:7279:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c609abb reply state 00000000a3b098e3 transno 4294967371 ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04ae95c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760754.159543:0:7279:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789760754.159571:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2200/0x3e099f5ef04ae94e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d205 expref: 19 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.159585:0:7279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2600/0x3e099f5ef04ae963 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d205 expref: 18 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.159593:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df250325f00) 00010000:00010000:2.0:1789760754.159595:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789760754.159598:0:7279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2517f2600, rc 0) 00000100:00100000:2.0:1789760754.159674:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df251668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+19:11039:x1876699863141248:12345-192.168.203.12@tcp:101:touch.500 Request processed in 1206us (3298us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1789760754.159681:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 106 00010000:00010000:0.0:1789760754.163060:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04ae95c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.163079:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04ae95c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.163086:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04ae95c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.163093:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3800 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760754.163098:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04ae95c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.163106:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04ae95c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.163121:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x572a2e26 (ffff8df250325500) 00010000:00010000:0.0:1789760754.163124:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760754.163128:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04ae95c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.163134:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04ae95c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760754.167347:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760754.169035:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863141504 00000100:00100000:2.0:1789760754.169050:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863141504 00000100:00100000:2.0:1789760754.169180:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 107 00000100:00100000:2.0:1789760754.169192:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25166b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+18:11039:x1876699863141504:12345-192.168.203.12@tcp:36:touch.500 00010000:00010000:2.0:1789760754.169263:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760754.169290:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2600/0x3e099f5ef04ae963 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d205 expref: 18 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.169328:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df250325f00) 00010000:00010000:2.0:1789760754.169340:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789760754.169383:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2a00/0x3e099f5ef04ae971 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.169396:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2a00/0x3e099f5ef04ae971 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.169406:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2a00/0x3e099f5ef04ae971 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760754.169540:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e52aa237 reply state 000000009ac16a43 transno 4294967372 ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2a00/0x3e099f5ef04ae971 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760754.169549:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789760754.169654:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25166b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+19:11039:x1876699863141504:12345-192.168.203.12@tcp:36:touch.500 Request processed in 463us (2316us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1789760754.169662:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 107 00010000:00010000:0.0:1789760754.176986:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2a00/0x3e099f5ef04ae971 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.177017:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2a00/0x3e099f5ef04ae971 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.177026:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2a00/0x3e099f5ef04ae971 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.177032:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2a00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760754.177037:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2a00/0x3e099f5ef04ae971 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.177046:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2a00/0x3e099f5ef04ae971 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.177061:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df250325400) 00010000:00010000:0.0:1789760754.177064:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760754.177069:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2a00/0x3e099f5ef04ae971 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.177075:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2a00/0x3e099f5ef04ae971 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760754.177308:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760754.178257:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863141632 00000100:00100000:2.0:1789760754.178268:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863141632 00000100:00100000:2.0:1789760754.178403:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 108 00000100:00100000:2.0:1789760754.178414:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+18:11039:x1876699863141632:12345-192.168.203.12@tcp:101:touch.500 00010000:00010000:2.0:1789760754.178438:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760754.178468:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2e00/0x3e099f5ef04ae978 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d20c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.178527:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2e00/0x3e099f5ef04ae978 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d20c expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.178559:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2e00/0x3e099f5ef04ae978 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d20c expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.178581:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df250325600) 00010000:00010000:2.0:1789760754.178584:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789760754.178587:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2517f2e00, rc 0) 00000100:00100000:2.0:1789760754.178653:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+19:11039:x1876699863141632:12345-192.168.203.12@tcp:101:touch.500 Request processed in 240us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760754.178670:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 108 00000100:00100000:0.0:1789760754.187430:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760754.187474:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760754.187542:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863141760 00000100:00100000:3.0:1789760754.187553:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863141760 00000100:00100000:3.0:1789760754.187607:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863141888 00000100:00100000:3.0:1789760754.187610:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863141888 00000100:00100000:3.0:1789760754.187640:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:3.0:1789760754.187649:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863141760:12345-192.168.203.12@tcp:2:touch.500 00000100:00100000:2.0:1789760754.187947:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:2.0:1789760754.187959:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d6f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863141888:12345-192.168.203.12@tcp:2:touch.500 00000100:00100000:3.0:1789760754.187989:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863141760:12345-192.168.203.12@tcp:2:touch.500 Request processed in 339us (567us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1789760754.187998:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:2.0:1789760754.188159:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d6f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863141888:12345-192.168.203.12@tcp:2:touch.500 Request processed in 202us (684us total) trans 4294967427 rc 0/0 00000100:00100000:2.0:1789760754.188167:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:1.0:1789760754.193332:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760754.195056:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863142144 00000100:00100000:2.0:1789760754.195068:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863142144 00000100:00100000:2.0:1789760754.195388:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:2.0:1789760754.195404:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+19:11039:x1876699863142144:12345-192.168.203.12@tcp:35:touch.500 00000100:00100000:2.0:1789760754.195772:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+20:11039:x1876699863142144:12345-192.168.203.12@tcp:35:touch.500 Request processed in 373us (2448us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1789760754.195781:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:1.0:1789760754.237624:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760754.237701:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863142400 00000100:00100000:3.0:1789760754.237710:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863142400 00000100:00100000:3.0:1789760754.237768:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00100000:3.0:1789760754.237778:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+20:11043:x1876699863142400:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1789760754.237846:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760754.237868:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbec00/0x3e099f5ef04ae97f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d213 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760754.237973:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 16384 00010000:00010000:3.0:1789760754.238084:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbec00/0x3e099f5ef04ae97f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d213 expref: 22 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.238098:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df245dcc300) 00010000:00010000:3.0:1789760754.238101:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789760754.238106:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbec00/0x3e099f5ef04ae97f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d213 expref: 22 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.238122:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df277dbec00, rc 0) 00000100:00100000:3.0:1789760754.238174:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+21:11043:x1876699863142400:12345-192.168.203.12@tcp:101:bash.0 Request processed in 397us (559us total) trans 4294967374 rc 301/301 00000100:00100000:3.0:1789760754.238180:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00100000:0.0:1789760754.240072:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760754.240164:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863142528 00000100:00100000:2.0:1789760754.240172:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863142528 00000100:00100000:2.0:1789760754.240218:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 110 00000100:00100000:2.0:1789760754.240246:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+21:11043:x1876699863142528:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1789760754.240266:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760754.240283:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2600/0x3e099f5ef04ae98d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d21a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.240352:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2200/0x3e099f5ef04ae994 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.240365:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2200/0x3e099f5ef04ae994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.240377:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2200/0x3e099f5ef04ae994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760754.240407:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 16384 00000004:00200000:2.0:1789760754.240410:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789760754.240425:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2200/0x3e099f5ef04ae994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.240447:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2600/0x3e099f5ef04ae98d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d21a expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.240461:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2200/0x3e099f5ef04ae994 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d21a expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.240468:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df2502f3500) 00010000:00010000:2.0:1789760754.240471:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789760754.240473:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2517f2200, rc 0) 00000100:00100000:2.0:1789760754.240525:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+22:11043:x1876699863142528:12345-192.168.203.12@tcp:101:bash.0 Request processed in 281us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760754.240538:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 110 00000100:00100000:0.0:1789760754.244356:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760754.246007:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863142656 00000100:00100000:3.0:1789760754.246021:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863142656 00000100:00100000:3.0:1789760754.246084:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:3.0:1789760754.246095:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24767e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+22:11043:x1876699863142656:12345-192.168.203.12@tcp:37:bash.0 00000100:00100000:2.0:1789760754.254434:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24767e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+22:11043:x1876699863142656:12345-192.168.203.12@tcp:37:bash.0 Request processed in 8331us (10076us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760754.254447:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:2.0:1789760754.264963:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760754.265052:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863142912 00000100:00100000:1.0:1789760754.265061:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863142912 00000100:00100000:1.0:1789760754.265116:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:1.0:1789760754.265126:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+22:11043:x1876699863142912:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:1.0:1789760754.265381:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+23:11043:x1876699863142912:12345-192.168.203.12@tcp:35:bash.0 Request processed in 255us (426us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1789760754.265389:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:0.0:1789760754.291863:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760754.291911:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760754.292240:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863143040 00000100:00100000:2.0:1789760754.292250:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863143040 00000100:00100000:2.0:1789760754.292310:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 279 00000100:00100000:2.0:1789760754.292319:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2349:x1876699863143040:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1789760754.292395:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2349:x1876699863143040:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 76us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760754.292403:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 279 00000100:00100000:3.0:1789760754.292572:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863143168 00000100:00100000:3.0:1789760754.292642:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863143168 00000100:00100000:3.0:1789760754.292732:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 169 00000100:00100000:3.0:1789760754.292740:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2349:x1876699863143168:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760754.292785:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2349:x1876699863143168:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 46us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760754.292792:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 169 00000100:00080000:2.0:1789760754.293184:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760754.297756:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760754.297900:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863143296 00000100:00100000:2.0:1789760754.297909:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863143296 00000100:00100000:2.0:1789760754.297967:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 111 00000100:00100000:2.0:1789760754.298103:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+23:11043:x1876699863143296:12345-192.168.203.12@tcp:101:chmod.500 00010000:00010000:2.0:1789760754.298129:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760754.298152:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2600/0x3e099f5ef04ae99b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d221 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.298213:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04ae9a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.298308:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04ae9a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.298336:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04ae9a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.298352:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3000/0x3e099f5ef04ae9a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.298359:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3000/0x3e099f5ef04ae9a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.298365:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3000/0x3e099f5ef04ae9a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.298467:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04ae9b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.298476:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04ae9b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.298482:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04ae9b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760754.298507:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xf:0x0]: returning size 0 00000004:00200000:2.0:1789760754.298511:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789760754.298548:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04ae9b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.298559:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04ae9b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.298567:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04ae9a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.298583:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04ae9a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.298589:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04ae9a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.298595:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3600 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760754.298599:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04ae9a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.298607:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04ae9a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.298619:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df2502f3500) 00010000:00010000:2.0:1789760754.298622:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760754.298627:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04ae9a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.298633:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04ae9a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.298646:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3000/0x3e099f5ef04ae9a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.298652:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3000/0x3e099f5ef04ae9a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.298658:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3000/0x3e099f5ef04ae9a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.298663:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3000 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760754.298671:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3000/0x3e099f5ef04ae9a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.298678:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3000/0x3e099f5ef04ae9a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.298686:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0xe7cddcd6 (ffff8df250325f00) 00010000:00010000:2.0:1789760754.298689:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760754.298691:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3000/0x3e099f5ef04ae9a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.298697:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3000/0x3e099f5ef04ae9a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.298727:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2600/0x3e099f5ef04ae99b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d221 expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.298741:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04ae9b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d221 expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.298748:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff8df245dcc800) 00010000:00010000:2.0:1789760754.298750:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789760754.298753:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2517f2000, rc 0) 00000100:00100000:2.0:1789760754.300710:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+24:11043:x1876699863143296:12345-192.168.203.12@tcp:101:chmod.500 Request processed in 2725us (2952us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760754.301309:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 111 00000100:00100000:0.0:1789760754.305414:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760754.305459:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760754.307406:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863143424 00000100:00100000:3.0:1789760754.307436:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863143424 00000100:00100000:3.0:1789760754.307503:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863143552 00000100:00100000:3.0:1789760754.307507:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863143552 00000100:00100000:3.0:1789760754.307534:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:3.0:1789760754.307544:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c650380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863143424:12345-192.168.203.12@tcp:101:chmod.500 00010000:00010000:3.0:1789760754.307562:0:8482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760754.307584:0:8482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005521a6f5/0x3e099f5ef04ae9b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d228 expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760754.307610:0:8482:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x6aad94f1, atime: 0x6aad94f1, ctime: 0x6aad94f1, blocks: 0x1 00010000:00010000:3.0:1789760754.307628:0:8482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=358s v=(0 0) 00010000:00010000:3.0:1789760754.307633:0:8482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760754.307642:0:8482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005521a6f5/0x3e099f5ef04ae9b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d228 expref: 7 pid: 8482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760754.307816:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:2.0:1789760754.307827:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863143552:12345-192.168.203.12@tcp:101:chmod.500 00010000:00010000:2.0:1789760754.307836:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760754.307854:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099791bdf/0x3e099f5ef04ae9be lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d22f expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760754.307871:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x6aad94f1, atime: 0x6aad94f1, ctime: 0x6aad94f1, blocks: 0x1 00010000:00010000:2.0:1789760754.307881:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=358s v=(0 0) 00010000:00010000:2.0:1789760754.307885:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760754.307891:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099791bdf/0x3e099f5ef04ae9be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d22f expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.307892:0:8482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005521a6f5/0x3e099f5ef04ae9b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d228 expref: 7 pid: 8482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.307904:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000099791bdf/0x3e099f5ef04ae9be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d22f expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.307907:0:8482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df277dbec00, rc 0) 00010000:00010000:2.0:1789760754.307912:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2517f2c00, rc 0) 00000100:00100000:2.0:1789760754.308182:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+7:2350:x1876699863143552:12345-192.168.203.12@tcp:101:chmod.500 Request processed in 357us (2721us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760754.308189:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:3.0:1789760754.309951:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c650380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+7:2350:x1876699863143424:12345-192.168.203.12@tcp:101:chmod.500 Request processed in 2398us (4537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760754.309962:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:0.0:1789760754.319241:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760754.319481:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863143808 00000100:00100000:3.0:1789760754.319492:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863143808 00000100:00100000:3.0:1789760754.319555:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 112 00000100:00100000:3.0:1789760754.319565:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+24:11043:x1876699863143808:12345-192.168.203.12@tcp:36:chmod.500 00010000:00010000:3.0:1789760754.319621:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760754.319663:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04ae9b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d221 expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.319680:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff8df245dcc800) 00010000:00010000:3.0:1789760754.319685:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789760754.319711:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf200/0x3e099f5ef04ae9c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.319724:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf200/0x3e099f5ef04ae9c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.319734:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf200/0x3e099f5ef04ae9c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760754.319985:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000afe430e2 reply state 000000001632291b transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf200/0x3e099f5ef04ae9c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760754.319994:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789760754.320349:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+25:11043:x1876699863143808:12345-192.168.203.12@tcp:36:chmod.500 Request processed in 784us (1124us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1789760754.320357:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 112 00010000:00010000:0.0:1789760754.324150:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf200/0x3e099f5ef04ae9c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.324166:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf200/0x3e099f5ef04ae9c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.324174:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf200/0x3e099f5ef04ae9c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.324180:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df277dbf200 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760754.324185:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf200/0x3e099f5ef04ae9c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.324193:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf200/0x3e099f5ef04ae9c5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.324210:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff8df245dcc800) 00010000:00010000:0.0:1789760754.324213:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789760754.324218:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf200/0x3e099f5ef04ae9c5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.324224:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbf200/0x3e099f5ef04ae9c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760754.324570:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760754.324840:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863144064 00000100:00100000:2.0:1789760754.324850:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863144064 00000100:00100000:2.0:1789760754.324903:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:2.0:1789760754.324914:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+7:2351:x1876699863144064:12345-192.168.203.12@tcp:2:chmod.500 00002000:00010000:2.0:1789760754.325116:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789760754.325119:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789760753 -> 1789760753 00002000:00010000:2.0:1789760754.325122:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789760753 -> 1789760753 00002000:00010000:2.0:1789760754.325125:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789760753 -> 1789760753 00002000:00010000:2.0:1789760754.325127:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789760754.325179:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+8:2351:x1876699863144064:12345-192.168.203.12@tcp:2:chmod.500 Request processed in 266us (613us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1789760754.325200:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:0.0:1789760754.325312:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760754.325439:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863143936 00000100:00100000:1.0:1789760754.325444:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863143936 00000100:00100000:1.0:1789760754.325489:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:1.0:1789760754.325497:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+7:2351:x1876699863143936:12345-192.168.203.12@tcp:2:chmod.500 00002000:00010000:1.0:1789760754.325612:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789760754.325616:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760753 -> 1789760753 00002000:00010000:1.0:1789760754.325619:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1789760753 -> 1789760753 00002000:00010000:1.0:1789760754.325621:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760753 -> 1789760753 00002000:00010000:1.0:1789760754.325624:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789760754.325646:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+8:2351:x1876699863143936:12345-192.168.203.12@tcp:2:chmod.500 Request processed in 150us (334us total) trans 4294967428 rc 0/0 00000100:00100000:1.0:1789760754.325653:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:1.0:1789760754.331995:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760754.332242:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863144192 00000100:00100000:0.0:1789760754.332253:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863144192 00000100:00100000:0.0:1789760754.332320:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 113 00000100:00100000:0.0:1789760754.332330:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+24:11043:x1876699863144192:12345-192.168.203.12@tcp:101:chmod.500 00010000:00010000:0.0:1789760754.332378:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760754.332398:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ae9cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d236 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.332478:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04ae9d3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.332493:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04ae9d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.332504:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04ae9d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.332518:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae9da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.332526:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae9da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.332532:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae9da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.332634:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ce00/0x3e099f5ef04ae9e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.332645:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ce00/0x3e099f5ef04ae9e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.332652:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ce00/0x3e099f5ef04ae9e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760754.332684:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x10:0x0]: returning size 0 00000004:00200000:0.0:1789760754.332694:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789760754.332717:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ce00/0x3e099f5ef04ae9e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.332729:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ce00/0x3e099f5ef04ae9e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.332737:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04ae9d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.332743:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04ae9d3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.332751:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04ae9d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.332757:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2778e8a00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760754.332760:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04ae9d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.332768:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04ae9d3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.332779:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df2502f3500) 00010000:00010000:0.0:1789760754.332783:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760754.332787:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04ae9d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.332792:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8a00/0x3e099f5ef04ae9d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.332844:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae9da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.332862:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae9da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.332868:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae9da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.332873:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2778e9a00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760754.332876:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae9da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.332882:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae9da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.332891:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x572a2e26 (ffff8df2502f3f00) 00010000:00010000:0.0:1789760754.332893:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760754.332896:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae9da lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.332902:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9a00/0x3e099f5ef04ae9da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.332933:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e8c00/0x3e099f5ef04ae9cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d236 expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.332945:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ce00/0x3e099f5ef04ae9e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d236 expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.332950:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df250325600) 00010000:00010000:0.0:1789760754.332952:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789760754.332959:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df24627ce00, rc 0) 00000100:00100000:0.0:1789760754.333022:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+25:11043:x1876699863144192:12345-192.168.203.12@tcp:101:chmod.500 Request processed in 693us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760754.333028:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 113 00000100:00100000:3.0:1789760754.338062:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760754.338251:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863144320 00000100:00100000:2.0:1789760754.338261:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863144320 00000100:00100000:2.0:1789760754.338322:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:2.0:1789760754.338332:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df142e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+8:2349:x1876699863144320:12345-192.168.203.12@tcp:101:chmod.500 00010000:00010000:2.0:1789760754.338349:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760754.338369:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ead603cd/0x3e099f5ef04ae9e8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d23d expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760754.338393:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x6aad94f1, atime: 0x6aad94f1, ctime: 0x6aad94f1, blocks: 0x1 00010000:00010000:2.0:1789760754.338413:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=358s v=(0 0) 00010000:00010000:2.0:1789760754.338418:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760754.338427:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ead603cd/0x3e099f5ef04ae9e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d23d expref: 9 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.338443:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ead603cd/0x3e099f5ef04ae9e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d23d expref: 9 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760754.338466:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2517f3000, rc 0) 00000100:00100000:2.0:1789760754.338841:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df142e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+9:2349:x1876699863144320:12345-192.168.203.12@tcp:101:chmod.500 Request processed in 508us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760754.338848:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:2.0:1789760754.341558:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760754.341724:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863144448 00000100:00100000:3.0:1789760754.341734:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863144448 00000100:00100000:3.0:1789760754.341788:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:3.0:1789760754.341798:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+8:2349:x1876699863144448:12345-192.168.203.12@tcp:101:chmod.500 00010000:00010000:0.0:1789760754.342037:0:8482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760754.342058:0:8482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a99bef87/0x3e099f5ef04ae9ef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d244 expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760754.342086:0:8482:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x6aad94f1, atime: 0x6aad94f1, ctime: 0x6aad94f1, blocks: 0x1 00010000:00010000:0.0:1789760754.342104:0:8482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=358s v=(0 0) 00010000:00010000:0.0:1789760754.342109:0:8482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760754.342119:0:8482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a99bef87/0x3e099f5ef04ae9ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d244 expref: 9 pid: 8482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.342136:0:8482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a99bef87/0x3e099f5ef04ae9ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d244 expref: 9 pid: 8482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.342148:0:8482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df24627d600, rc 0) 00000100:00100000:0.0:1789760754.342204:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+9:2349:x1876699863144448:12345-192.168.203.12@tcp:101:chmod.500 Request processed in 408us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760754.342211:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:0.0:1789760754.344788:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760754.344931:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863144704 00000100:00100000:3.0:1789760754.344940:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863144704 00000100:00100000:3.0:1789760754.344997:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:3.0:1789760754.345007:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+25:11043:x1876699863144704:12345-192.168.203.12@tcp:36:chmod.500 00010000:00010000:3.0:1789760754.345073:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760754.345099:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ce00/0x3e099f5ef04ae9e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d236 expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.345121:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df250325600) 00010000:00010000:3.0:1789760754.345125:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789760754.345152:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae9f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.345163:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae9f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.345172:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae9f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760754.345440:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004fc11918 reply state 00000000bd781041 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae9f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760754.346131:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789760754.346477:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+26:11043:x1876699863144704:12345-192.168.203.12@tcp:36:chmod.500 Request processed in 1469us (1694us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1789760754.346486:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:3.0:1789760754.349129:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760754.349209:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863144832 00000100:00100000:1.0:1789760754.349228:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863144832 00000100:00100000:1.0:1789760754.349296:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:1.0:1789760754.349306:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df142e40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+9:2348:x1876699863144832:12345-192.168.203.12@tcp:2:chmod.500 00002000:00010000:1.0:1789760754.349505:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789760754.349508:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789760753 -> 1789760753 00002000:00010000:1.0:1789760754.349511:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1789760753 -> 1789760753 00002000:00010000:1.0:1789760754.349513:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789760753 -> 1789760753 00002000:00010000:1.0:1789760754.349515:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789760754.349590:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df142e40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+10:2348:x1876699863144832:12345-192.168.203.12@tcp:2:chmod.500 Request processed in 285us (468us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1789760754.349597:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 70 00010000:00010000:0.0:1789760754.350335:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae9f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.350357:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae9f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.350369:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae9f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.350375:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df277dbfe00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760754.350379:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae9f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.350387:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae9f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.350402:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df250325600) 00010000:00010000:0.0:1789760754.350405:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789760754.350410:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae9f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.350416:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfe00/0x3e099f5ef04ae9f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760754.351277:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760754.351394:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863144960 00000100:00100000:3.0:1789760754.351402:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863144960 00000100:00100000:3.0:1789760754.351457:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:3.0:1789760754.351466:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+9:2349:x1876699863144960:12345-192.168.203.12@tcp:2:chmod.500 00002000:00010000:3.0:1789760754.351610:0:6695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789760754.351613:0:6695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1789760753 -> 1789760753 00002000:00010000:3.0:1789760754.351616:0:6695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1789760753 -> 1789760753 00002000:00010000:3.0:1789760754.351617:0:6695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789760753 -> 1789760753 00002000:00010000:3.0:1789760754.351619:0:6695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789760754.351678:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+10:2349:x1876699863144960:12345-192.168.203.12@tcp:2:chmod.500 Request processed in 212us (404us total) trans 4294967429 rc 0/0 00000100:00100000:3.0:1789760754.351685:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:3.0:1789760754.420674:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760754.420785:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863145216 00000100:00100000:0.0:1789760754.420795:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863145216 00000100:00100000:0.0:1789760754.420904:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:0.0:1789760754.420911:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df142e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+25:11047:x1876699863145216:12345-192.168.203.12@tcp:101:dd.500 00010000:00010000:0.0:1789760754.420931:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760754.420933:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789760754.420956:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2200/0x3e099f5ef04ae994 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d21a expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.420993:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df2502f3500) 00010000:00010000:0.0:1789760754.420998:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760754.421013:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c000/0x3e099f5ef04ae9fd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d24b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.421171:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627dc00/0x3e099f5ef04aea04 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.421185:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627dc00/0x3e099f5ef04aea04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.421195:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627dc00/0x3e099f5ef04aea04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.421209:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627de00/0x3e099f5ef04aea0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.421216:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627de00/0x3e099f5ef04aea0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.421223:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627de00/0x3e099f5ef04aea0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.421308:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627cc00/0x3e099f5ef04aea12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.421317:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627cc00/0x3e099f5ef04aea12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.421324:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627cc00/0x3e099f5ef04aea12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760754.421342:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xf:0x0]: returning size 0 00010000:00010000:0.0:1789760754.421438:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627dc00/0x3e099f5ef04aea04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.421446:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627dc00/0x3e099f5ef04aea04 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.421453:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627dc00/0x3e099f5ef04aea04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.421460:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627dc00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760754.421464:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627dc00/0x3e099f5ef04aea04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.421471:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627dc00/0x3e099f5ef04aea04 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.421480:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df2502f3500) 00010000:00010000:0.0:1789760754.421483:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760754.421487:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627dc00/0x3e099f5ef04aea04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.421493:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627dc00/0x3e099f5ef04aea04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.421503:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627de00/0x3e099f5ef04aea0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.421510:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627de00/0x3e099f5ef04aea0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.421530:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627de00/0x3e099f5ef04aea0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.421536:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627de00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760754.421539:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627de00/0x3e099f5ef04aea0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.421546:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627de00/0x3e099f5ef04aea0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.421554:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0xe7cddcd6 (ffff8df2502f3f00) 00010000:00010000:0.0:1789760754.421556:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760754.421559:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627de00/0x3e099f5ef04aea0b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.421564:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627de00/0x3e099f5ef04aea0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.421603:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c000/0x3e099f5ef04ae9fd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d24b expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.421616:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627cc00/0x3e099f5ef04aea12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d24b expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.421623:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff8df245dcc800) 00010000:00010000:0.0:1789760754.421625:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789760754.421628:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df24627cc00, rc 0) 00000100:00100000:0.0:1789760754.421693:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df142e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+26:11047:x1876699863145216:12345-192.168.203.12@tcp:101:dd.500 Request processed in 778us (1025us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1789760754.421710:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:2.0:1789760754.424781:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760754.424979:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863145472 00000100:00100000:1.0:1789760754.424989:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863145472 00000100:00100000:1.0:1789760754.425077:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 116 00000100:00100000:1.0:1789760754.425088:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+26:11047:x1876699863145472:12345-192.168.203.12@tcp:36:dd.500 00010000:00010000:1.0:1789760754.425142:0:7279:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760754.425167:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627cc00/0x3e099f5ef04aea12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d24b expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760754.425185:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff8df245dcc800) 00010000:00010000:1.0:1789760754.425189:0:7279:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789760754.425407:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e000/0x3e099f5ef04aea20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760754.425420:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e000/0x3e099f5ef04aea20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760754.425431:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e000/0x3e099f5ef04aea20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760754.425492:0:7279:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967379 00000004:00010000:1.0:1789760754.425516:0:7279:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000413279b9 reply state 00000000230ae111 transno 4294967380 ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e000/0x3e099f5ef04aea20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760754.425524:0:7279:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789760754.425609:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+28:11047:x1876699863145472:12345-192.168.203.12@tcp:36:dd.500 Request processed in 523us (835us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1789760754.425617:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 116 00000020:00080000:1.0:1789760754.425630:0:7279:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789760754.427540:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e000/0x3e099f5ef04aea20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.427557:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e000/0x3e099f5ef04aea20 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.427565:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e000/0x3e099f5ef04aea20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.427571:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861e000 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760754.427576:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e000/0x3e099f5ef04aea20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.427585:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e000/0x3e099f5ef04aea20 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.427600:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff8df245dcc800) 00010000:00010000:0.0:1789760754.427602:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760754.427607:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e000/0x3e099f5ef04aea20 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.427612:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861e000/0x3e099f5ef04aea20 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760754.431040:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760754.431246:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863145600 00000100:00100000:3.0:1789760754.431255:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863145600 00000100:00100000:3.0:1789760754.431444:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:3.0:1789760754.431454:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+10:11047:x1876699863145600:12345-192.168.203.12@tcp:101:dd.500 00010000:00010000:3.0:1789760754.431470:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760754.431486:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b81484bf/0x3e099f5ef04aea27 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d252 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.431513:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005521a6f5/0x3e099f5ef04ae9b7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d228 expref: 11 pid: 8482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.431522:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760754.431526:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760754.431532:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b81484bf/0x3e099f5ef04aea27 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d252 expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.431562:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005521a6f5/0x3e099f5ef04ae9b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d228 expref: 11 pid: 8482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.431574:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005521a6f5/0x3e099f5ef04ae9b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d228 expref: 11 pid: 8482 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760754.431604:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df142e43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1876699883052928:192.168.203.12@tcp:104: 00000100:00100000:3.0:1789760754.431695:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df27cdb4840 going to sleep for 11 seconds 00000100:00100000:3.0:1789760754.433218:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df142e43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1876699883052928:192.168.203.12@tcp:104: 00010000:00010000:3.0:1789760754.433260:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b81484bf/0x3e099f5ef04aea27 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d252 expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.433285:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df277dbe400, rc 0) 00000100:00100000:3.0:1789760754.433335:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+11:11047:x1876699863145600:12345-192.168.203.12@tcp:101:dd.500 Request processed in 1882us (2303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760754.433343:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:0.0:1789760754.434900:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760754.435104:0:7645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863145728 00000100:00100000:3.0:1789760754.435112:0:7645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863145728 00010000:00010000:3.0:1789760754.435150:0:7645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005521a6f5/0x3e099f5ef04ae9b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d228 expref: 11 pid: 8482 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760754.435189:0:7645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:3.0:1789760754.435199:0:7645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1da0113a-370d-4d79-883c-54efc174697f+11:2349:x1876699863145728:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789760754.435212:0:7645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760754.435218:0:7645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005521a6f5/0x3e099f5ef04ae9b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d228 expref: 11 pid: 8482 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.435240:0:7645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005521a6f5/0x3e099f5ef04ae9b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d228 expref: 11 pid: 8482 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.435352:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005521a6f5/0x3e099f5ef04ae9b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d228 expref: 11 pid: 8482 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.435369:0:7645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760754.435373:0:7645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760754.435379:0:7645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b81484bf/0x3e099f5ef04aea27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d252 expref: 10 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.435388:0:7645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b81484bf/0x3e099f5ef04aea27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d252 expref: 10 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.435423:0:7645:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b81484bf/0x3e099f5ef04aea27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d252 expref: 10 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760754.435436:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df142e43800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7645:1876699883053056:192.168.203.12@tcp:105: 00000100:00100000:3.0:1789760754.435620:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df27cdb4840 going to sleep for 11 seconds 00000100:00100000:2.0:1789760754.438853:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760754.438939:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863145856 00000100:00100000:0.0:1789760754.438949:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863145856 00000100:00100000:0.0:1789760754.439018:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:0.0:1789760754.439029:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+10:11047:x1876699863145856:12345-192.168.203.12@tcp:101:dd.500 00010000:00010000:0.0:1789760754.439062:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760754.439079:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e85c43d2/0x3e099f5ef04aea2e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d259 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.439110:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000099791bdf/0x3e099f5ef04ae9be lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d22f expref: 11 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.439120:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760754.439125:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760754.439129:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e85c43d2/0x3e099f5ef04aea2e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d259 expref: 11 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.439161:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000099791bdf/0x3e099f5ef04ae9be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d22f expref: 11 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.439174:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000099791bdf/0x3e099f5ef04ae9be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d22f expref: 11 pid: 6695 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760754.439186:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e39f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6695:1876699883053184:192.168.203.12@tcp:104: 00000100:00100000:0.0:1789760754.439426:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df24574d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760754.439647:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df142e43800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7645:1876699883053056:192.168.203.12@tcp:105: 00010000:00010000:3.0:1789760754.439733:0:7645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760754.439764:0:7645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1da0113a-370d-4d79-883c-54efc174697f+10:2349:x1876699863145728:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 4566us (4870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760754.439773:0:7645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:2.0:1789760754.444355:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760754.444501:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863145984 00000100:00100000:3.0:1789760754.444510:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863145984 00010000:00010000:3.0:1789760754.444549:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000099791bdf/0x3e099f5ef04ae9be lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d22f expref: 12 pid: 6695 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760754.444612:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:3.0:1789760754.444622:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1da0113a-370d-4d79-883c-54efc174697f+12:2348:x1876699863145984:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789760754.444637:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760754.444643:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000099791bdf/0x3e099f5ef04ae9be lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d22f expref: 12 pid: 6695 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.444656:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000099791bdf/0x3e099f5ef04ae9be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d22f expref: 12 pid: 6695 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.444691:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760754.444696:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760754.444703:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e85c43d2/0x3e099f5ef04aea2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d259 expref: 12 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.444711:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e85c43d2/0x3e099f5ef04aea2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d259 expref: 12 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760754.444741:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e85c43d2/0x3e099f5ef04aea2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d259 expref: 12 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760754.444751:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df142e43800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5831:1876699883053312:192.168.203.12@tcp:105: 00000100:00100000:3.0:1789760754.444838:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df27cdb4840 going to sleep for 11 seconds 00010000:00010000:0.0:1789760754.444988:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099791bdf/0x3e099f5ef04ae9be lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d22f expref: 12 pid: 6695 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760754.445004:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258e39f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6695:1876699883053184:192.168.203.12@tcp:104: 00010000:00010000:0.0:1789760754.445028:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e85c43d2/0x3e099f5ef04aea2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d259 expref: 11 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760754.445050:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df24627de00, rc 0) 00000100:00100000:0.0:1789760754.445079:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+11:11047:x1876699863145856:12345-192.168.203.12@tcp:101:dd.500 Request processed in 6052us (6234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760754.445086:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:1.0:1789760754.449527:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760754.449564:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760754.449764:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df142e43800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5831:1876699883053312:192.168.203.12@tcp:105: 00010000:00010000:3.0:1789760754.449830:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760754.449878:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1da0113a-370d-4d79-883c-54efc174697f+10:2348:x1876699863145984:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 5256us (5531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760754.449889:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:0.0:1789760754.451592:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863146112 00000100:00100000:0.0:1789760754.451607:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863146112 00002000:00010000:0.0:1789760754.451651:0:11801:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1789760754.451656:0:11801:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df144606d80 with x1876699863146112 ext(0->18446744073709551615) 00002000:00010000:0.0:1789760754.451735:0:11801:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df144606d80. 00000100:00100000:0.0:1789760754.451758:0:11801:0:(nrs_tbf.c:1321:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 3 deadline 0 time 358564949209 state 0x0 ref 1 00000100:00100000:0.0:1789760754.451769:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 3 deadline 358764949209 time 358564949209 state 0x1 ref 1 00000100:00100000:0.0:1789760754.451854:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863146240 00000100:00100000:0.0:1789760754.451858:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863146240 00002000:00010000:0.0:1789760754.451874:0:11801:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1789760754.451877:0:11801:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df144665f80 with x1876699863146240 ext(0->18446744073709551615) 00002000:00010000:0.0:1789760754.451883:0:11801:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df144665f80. 00000100:00100000:0.0:1789760754.451889:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 3 deadline 358764949209 time 358564949209 state 0x1 ref 2 00000100:00100000:0.0:1789760754.451917:0:11801:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 2 deadline 358765112528 time 358565112528 state 0x1 ref 2 00000100:00100000:0.0:1789760754.451933:0:11801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+10:2348:x1876699863146112:12345-192.168.203.12@tcp:10:dd.500 00000100:00100000:3.0:1789760754.452052:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 1 deadline 358765112528 time 358565245065 state 0x0 ref 2 00000100:00100000:3.0:1789760754.452065:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+10:2348:x1876699863146240:12345-192.168.203.12@tcp:10:dd.500 00002000:00010000:3.0:1789760754.452344:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789760754.452347:0:11799:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789760753 -> 1789760753 00002000:00010000:3.0:1789760754.452350:0:11799:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789760753 -> 1789760753 00002000:00010000:3.0:1789760754.452352:0:11799:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789760753 -> 1789760753 00002000:00010000:3.0:1789760754.452354:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789760754.452415:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+11:2348:x1876699863146240:12345-192.168.203.12@tcp:10:dd.500 Request processed in 351us (2848us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1789760754.452423:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 1 00002000:00010000:3.0:1789760754.452427:0:11799:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1789760754.452430:0:11799:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df144665f80 with x1876699863146240 ext(0->18446744073709551615) 00002000:00010000:3.0:1789760754.452435:0:11799:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df144665f80. 00002000:00010000:0.0:1789760754.453091:0:11801:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789760754.453096:0:11801:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760753 -> 1789760753 00002000:00010000:0.0:1789760754.453098:0:11801:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1789760753 -> 1789760753 00002000:00010000:0.0:1789760754.453112:0:11801:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760753 -> 1789760753 00002000:00010000:0.0:1789760754.453115:0:11801:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789760754.453162:0:11801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+11:2348:x1876699863146112:12345-192.168.203.12@tcp:10:dd.500 Request processed in 1233us (3643us total) trans 4294967430 rc 0/0 00000100:00100000:0.0:1789760754.453170:0:11801:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:0.0:1789760754.453175:0:11801:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 1 deadline 358765112528 time 358565245065 state 0x2 ref 0 00002000:00010000:0.0:1789760754.453181:0:11801:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1789760754.453183:0:11801:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df144606d80 with x1876699863146112 ext(0->18446744073709551615) 00002000:00010000:0.0:1789760754.453189:0:11801:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df144606d80. 00000100:00100000:1.0:1789760754.482342:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760754.482445:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863146368 00000100:00100000:0.0:1789760754.482466:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863146368 00002000:00100000:0.0:1789760754.482517:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->1048575) req@ffff8df144667800 x1876699863146368/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:45/0 lens 488/0 e 0 to 0 dl 1789760765 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760754.482528:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df144667800 with x1876699863146368 ext(0->1048575) 00002000:00010000:0.0:1789760754.482533:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df144667800 00000100:00100000:0.0:1789760754.482547:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 1 deadline 358765112528 time 358565245065 state 0x0 ref 1 00000100:00100000:0.0:1789760754.482559:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 1 deadline 358765245065 time 358565245065 state 0x1 ref 1 00000100:00100000:0.0:1789760754.482594:0:6698:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 358765245065 time 358595788401 state 0x0 ref 1 00000100:00100000:0.0:1789760754.482607:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+11:2349:x1876699863146368:12345-192.168.203.12@tcp:4:dd.500 00000100:00100000:0.0:1789760754.502214:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+13:2349:x1876699863146368:12345-192.168.203.12@tcp:4:dd.500 Request processed in 19598us (19870us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1789760754.502227:0:6698:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:0.0:1789760754.503300:0:6698:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 358765245065 time 358595788401 state 0x2 ref 0 00002000:00100000:0.0:1789760754.503331:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->1048575) req@ffff8df144667800 x1876699863146368/t4294967431(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:45/0 lens 488/448 e 0 to 0 dl 1789760765 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760754.503342:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df144667800 with x1876699863146368 ext(0->1048575) 00002000:00010000:0.0:1789760754.503348:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df144667800 00000100:00100000:3.0:1789760754.509295:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760754.509727:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863146496 00000100:00100000:1.0:1789760754.509737:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863146496 00002000:00100000:1.0:1789760754.509787:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (1048576->2097151) req@ffff8df142e43800 x1876699863146496/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:45/0 lens 488/0 e 0 to 0 dl 1789760765 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789760754.509798:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df142e43800 with x1876699863146496 ext(1048576->2097151) 00002000:00010000:1.0:1789760754.509842:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df142e43800 00000100:00100000:1.0:1789760754.509857:0:6700:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 358765245065 time 358595788401 state 0x0 ref 1 00000100:00100000:1.0:1789760754.509868:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 358795788401 time 358595788401 state 0x1 ref 1 00000100:00100000:1.0:1789760754.526355:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760754.531744:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863146624 00000100:00100000:2.0:1789760754.531760:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863146624 00002000:00100000:2.0:1789760754.531830:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (2097152->3145727) req@ffff8df144664700 x1876699863146624/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:45/0 lens 488/0 e 0 to 0 dl 1789760765 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760754.531841:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df144664700 with x1876699863146624 ext(2097152->3145727) 00002000:00010000:2.0:1789760754.531847:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df144664700 00000100:00100000:2.0:1789760754.531862:0:6699:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 358795788401 time 358595788401 state 0x1 ref 2 00000100:00100000:3.0:1789760754.548776:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760754.550109:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863146752 00000100:00100000:2.0:1789760754.550121:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863146752 00002000:00100000:2.0:1789760754.550174:0:11797:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x5:0x0] (3145728->4194303) req@ffff8df2747b8700 x1876699863146752/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:45/0 lens 488/0 e 0 to 0 dl 1789760765 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760754.550185:0:11797:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df2747b8700 with x1876699863146752 ext(3145728->4194303) 00002000:00010000:2.0:1789760754.550191:0:11797:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df2747b8700 00000100:00100000:2.0:1789760754.550208:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 358795788401 time 358595788401 state 0x1 ref 3 00000100:00100000:2.0:1789760754.559218:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760754.560623:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863146880 00000100:00100000:1.0:1789760754.560634:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863146880 00002000:00100000:0.0:1789760754.562966:0:11796:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x5:0x0] (0->1048575) req@ffff8df2747f8a80 x1876699863146880/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:45/0 lens 488/0 e 0 to 0 dl 1789760765 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760754.562980:0:11796:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df2747f8a80 with x1876699863146880 ext(0->1048575) 00002000:00010000:0.0:1789760754.562987:0:11796:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df2747f8a80 00000100:00100000:0.0:1789760754.563004:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 358795788401 time 358595788401 state 0x1 ref 4 00000100:00100000:1.0:1789760754.572464:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760754.575519:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863147008 00000100:00100000:0.0:1789760754.575532:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863147008 00002000:00100000:0.0:1789760754.575591:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (1048576->2097151) req@ffff8df27cae3b80 x1876699863147008/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:45/0 lens 488/0 e 0 to 0 dl 1789760765 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760754.575602:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cae3b80 with x1876699863147008 ext(1048576->2097151) 00002000:00010000:0.0:1789760754.575608:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df27cae3b80 00000100:00100000:0.0:1789760754.575624:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 358795788401 time 358595788401 state 0x1 ref 5 00000100:00100000:0.0:1789760754.684558:0:11800:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 358997742677 time 358797742677 state 0x1 ref 5 00000100:00100000:0.0:1789760754.684591:0:11800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df142e43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+15:2350:x1876699863146496:12345-192.168.203.12@tcp:4:dd.500 00000100:00100000:0.0:1789760754.699663:0:11800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df142e43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+17:2350:x1876699863146496:12345-192.168.203.12@tcp:4:dd.500 Request processed in 15075us (190365us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1789760754.700005:0:11800:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 3 00002000:00100000:0.0:1789760754.700022:0:11800:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x5:0x0] (1048576->2097151) req@ffff8df142e43800 x1876699863146496/t4294967432(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:45/0 lens 488/448 e 0 to 0 dl 1789760765 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760754.700048:0:11800:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df142e43800 with x1876699863146496 ext(1048576->2097151) 00002000:00010000:0.0:1789760754.700054:0:11800:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df142e43800 00000100:00100000:3.0:1789760754.886644:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 359199829655 time 358999829655 state 0x1 ref 4 00000100:00100000:3.0:1789760754.886741:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df144664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+16:2351:x1876699863146624:12345-192.168.203.12@tcp:4:dd.500 00010000:00010000:1.0:1789760754.895364:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760754.897427:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df144664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+18:2351:x1876699863146624:12345-192.168.203.12@tcp:4:dd.500 Request processed in 10755us (371072us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1789760754.897459:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 4 00002000:00100000:3.0:1789760754.897472:0:11799:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x5:0x0] (2097152->3145727) req@ffff8df144664700 x1876699863146624/t4294967433(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:45/0 lens 488/448 e 0 to 0 dl 1789760765 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789760754.897483:0:11799:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df144664700 with x1876699863146624 ext(2097152->3145727) 00002000:00010000:3.0:1789760754.897489:0:11799:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df144664700 00000100:00100000:2.0:1789760755.086771:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 359399955633 time 359199955633 state 0x1 ref 3 00000100:00100000:2.0:1789760755.086839:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+17:2351:x1876699863146752:12345-192.168.203.12@tcp:4:dd.500 00000100:00100000:2.0:1789760755.100426:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+19:2351:x1876699863146752:12345-192.168.203.12@tcp:4:dd.500 Request processed in 13628us (551649us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1789760755.100441:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 5 00002000:00100000:2.0:1789760755.100457:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (3145728->4194303) req@ffff8df2747b8700 x1876699863146752/t4294967434(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:45/0 lens 488/448 e 0 to 0 dl 1789760765 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760755.100478:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df2747b8700 with x1876699863146752 ext(3145728->4194303) 00002000:00010000:2.0:1789760755.100484:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df2747b8700 00000100:00100000:3.0:1789760755.280790:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789760755.280838:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883053440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789760755.280909:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760755.280996:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883053440 00000100:00100000:3.0:1789760755.281003:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883053440 00000100:00100000:3.0:1789760755.281065:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789760755.281077:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883053440:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789760755.281083:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789760755.281098:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 57868288 pending 6815744 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760755.281146:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883053440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760755.281161:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789760755.281209:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883053440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789760755.288913:0:11797:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 359602098354 time 359402098354 state 0x1 ref 2 00000100:00100000:0.0:1789760755.288945:0:11797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+12:2348:x1876699863146880:12345-192.168.203.12@tcp:4:dd.500 00000100:00100000:1.0:1789760755.323067:0:11797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+14:2348:x1876699863146880:12345-192.168.203.12@tcp:4:dd.500 Request processed in 34121us (763842us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1789760755.323082:0:11797:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 6 00002000:00100000:1.0:1789760755.323098:0:11797:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x5:0x0] (0->1048575) req@ffff8df2747f8a80 x1876699863146880/t4294967329(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:45/0 lens 488/448 e 0 to 0 dl 1789760765 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789760755.323109:0:11797:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df2747f8a80 with x1876699863146880 ext(0->1048575) 00002000:00010000:1.0:1789760755.323116:0:11797:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df2747f8a80 00000100:00100000:3.0:1789760755.331173:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760755.332091:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863147136 00000100:00100000:1.0:1789760755.332102:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863147136 00002000:00100000:1.0:1789760755.332168:0:11801:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x5:0x0] (2097152->3145727) req@ffff8df27cb21880 x1876699863147136/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:46/0 lens 488/0 e 0 to 0 dl 1789760766 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789760755.332181:0:11801:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cb21880 with x1876699863147136 ext(2097152->3145727) 00002000:00010000:1.0:1789760755.332187:0:11801:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df27cb21880 00000100:00100000:1.0:1789760755.332201:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 359602098354 time 359402098354 state 0x1 ref 2 00000001:00080000:2.0:1789760755.342386:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967378 is committed 00000001:00080000:2.0:1789760755.342410:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967380 is committed 00000100:00100000:1.0:1789760755.359467:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760755.359524:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863147264 00000100:00100000:0.0:1789760755.359534:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863147264 00002000:00100000:0.0:1789760755.359589:0:11796:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x5:0x0] (3145728->4194303) req@ffff8df274bc0a80 x1876699863147264/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:46/0 lens 488/0 e 0 to 0 dl 1789760766 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760755.359600:0:11796:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df274bc0a80 with x1876699863147264 ext(3145728->4194303) 00002000:00010000:0.0:1789760755.359605:0:11796:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df274bc0a80 00000100:00100000:0.0:1789760755.359621:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 359602098354 time 359402098354 state 0x1 ref 3 00000100:00100000:3.0:1789760755.392291:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760755.392435:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863147392 00000100:00100000:1.0:1789760755.392457:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863147392 00002000:00100000:1.0:1789760755.392522:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (4194304->5242879) req@ffff8df27cb21500 x1876699863147392/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:46/0 lens 488/0 e 0 to 0 dl 1789760766 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789760755.392535:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cb21500 with x1876699863147392 ext(4194304->5242879) 00002000:00010000:1.0:1789760755.392543:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df27cb21500 00000100:00100000:1.0:1789760755.392563:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 359602098354 time 359402098354 state 0x1 ref 4 00000100:00100000:3.0:1789760755.409546:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760755.409992:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863147520 00000100:00100000:2.0:1789760755.410006:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863147520 00002000:00100000:2.0:1789760755.410075:0:11799:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x5:0x0] (5242880->6291455) req@ffff8df27cb23800 x1876699863147520/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:46/0 lens 488/0 e 0 to 0 dl 1789760766 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760755.410089:0:11799:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cb23800 with x1876699863147520 ext(5242880->6291455) 00002000:00010000:2.0:1789760755.410095:0:11799:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df27cb23800 00000100:00100000:2.0:1789760755.410116:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 359602098354 time 359402098354 state 0x1 ref 5 00000100:00100000:1.0:1789760755.431989:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760755.432161:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863147648 00000100:00100000:2.0:1789760755.432177:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863147648 00002000:00100000:2.0:1789760755.432268:0:11797:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x5:0x0] (6291456->7340031) req@ffff8df27218a300 x1876699863147648/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:46/0 lens 488/0 e 0 to 0 dl 1789760766 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760755.432282:0:11797:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27218a300 with x1876699863147648 ext(6291456->7340031) 00002000:00010000:2.0:1789760755.432289:0:11797:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df27218a300 00000100:00100000:2.0:1789760755.432310:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 359602098354 time 359402098354 state 0x1 ref 6 00000100:00100000:3.0:1789760755.463896:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760755.464045:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863147776 00000100:00100000:1.0:1789760755.464060:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863147776 00002000:00100000:1.0:1789760755.464129:0:11801:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x5:0x0] (7340032->8388607) req@ffff8df27cb21f80 x1876699863147776/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:46/0 lens 488/0 e 0 to 0 dl 1789760766 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789760755.464143:0:11801:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cb21f80 with x1876699863147776 ext(7340032->8388607) 00002000:00010000:1.0:1789760755.464151:0:11801:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df27cb21f80 00000100:00100000:1.0:1789760755.464175:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 359602098354 time 359402098354 state 0x1 ref 7 00000100:00100000:1.0:1789760755.489069:0:6698:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 359802248375 time 359602248375 state 0x1 ref 7 00000100:00100000:1.0:1789760755.489117:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+15:2349:x1876699863147008:12345-192.168.203.12@tcp:4:dd.500 00000100:00100000:1.0:1789760755.505696:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+17:2349:x1876699863147008:12345-192.168.203.12@tcp:4:dd.500 Request processed in 16590us (933226us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1789760755.505713:0:6698:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 7 00002000:00100000:1.0:1789760755.505729:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (1048576->2097151) req@ffff8df27cae3b80 x1876699863147008/t4294967330(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:45/0 lens 488/448 e 0 to 0 dl 1789760765 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789760755.505742:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cae3b80 with x1876699863147008 ext(1048576->2097151) 00002000:00010000:1.0:1789760755.505750:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df27cae3b80 00000100:00100000:0.0:1789760755.516052:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760755.516166:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863147904 00000100:00100000:1.0:1789760755.516179:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863147904 00002000:00100000:1.0:1789760755.516257:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (4194304->5242879) req@ffff8df258e39f80 x1876699863147904/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:46/0 lens 488/0 e 0 to 0 dl 1789760766 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789760755.516269:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df258e39f80 with x1876699863147904 ext(4194304->5242879) 00002000:00010000:1.0:1789760755.516276:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df258e39f80 00000100:00100000:1.0:1789760755.516299:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 359802248375 time 359602248375 state 0x1 ref 7 00000100:00100000:3.0:1789760755.544332:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760755.544438:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863148032 00000100:00100000:2.0:1789760755.544457:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863148032 00002000:00100000:2.0:1789760755.544538:0:11799:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x5:0x0] (5242880->6291455) req@ffff8df27cb20000 x1876699863148032/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:46/0 lens 488/0 e 0 to 0 dl 1789760766 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760755.544552:0:11799:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cb20000 with x1876699863148032 ext(5242880->6291455) 00002000:00010000:2.0:1789760755.544580:0:11799:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df27cb20000 00000100:00100000:2.0:1789760755.544604:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 359802248375 time 359602248375 state 0x1 ref 8 00000100:00100000:2.0:1789760755.689251:0:11797:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 360002429099 time 359802429099 state 0x1 ref 8 00000100:00100000:2.0:1789760755.689298:0:11797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+18:2349:x1876699863147136:12345-192.168.203.12@tcp:4:dd.500 00000100:00100000:2.0:1789760755.715513:0:11797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+20:2349:x1876699863147136:12345-192.168.203.12@tcp:4:dd.500 Request processed in 26224us (384333us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789760755.715530:0:11797:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 8 00002000:00100000:2.0:1789760755.715547:0:11797:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x5:0x0] (2097152->3145727) req@ffff8df27cb21880 x1876699863147136/t4294967331(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:46/0 lens 488/448 e 0 to 0 dl 1789760766 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760755.715558:0:11797:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cb21880 with x1876699863147136 ext(2097152->3145727) 00002000:00010000:2.0:1789760755.715566:0:11797:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df27cb21880 00000100:00100000:1.0:1789760755.723422:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760755.732143:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863148160 00000100:00100000:3.0:1789760755.732163:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863148160 00002000:00100000:3.0:1789760755.732250:0:11798:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x5:0x0] (6291456->7340031) req@ffff8df272189880 x1876699863148160/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:46/0 lens 488/0 e 0 to 0 dl 1789760766 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789760755.732280:0:11798:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df272189880 with x1876699863148160 ext(6291456->7340031) 00002000:00010000:3.0:1789760755.732286:0:11798:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df272189880 00000100:00100000:3.0:1789760755.732306:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 360002429099 time 359802429099 state 0x1 ref 8 00000100:00100000:3.0:1789760755.756751:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760755.756857:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760755.757217:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863148544 00000100:00100000:0.0:1789760755.757242:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863148544 00002000:00100000:0.0:1789760755.757309:0:11796:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x5:0x0] (7340032->8388607) req@ffff8df2747bb800 x1876699863148544/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:46/0 lens 488/0 e 0 to 0 dl 1789760766 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760755.757322:0:11796:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df2747bb800 with x1876699863148544 ext(7340032->8388607) 00002000:00010000:0.0:1789760755.757330:0:11796:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df2747bb800 00000100:00100000:0.0:1789760755.757352:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 360002429099 time 359802429099 state 0x1 ref 9 00000100:00100000:1.0:1789760755.757640:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863148416 00000100:00100000:1.0:1789760755.757646:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863148416 00000100:00100000:1.0:1789760755.757710:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:1.0:1789760755.757723:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+9:11047:x1876699863148416:12345-192.168.203.12@tcp:35:dd.500 00000001:00080000:1.0:1789760755.758268:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000100:00100000:1.0:1789760755.758412:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+11:11047:x1876699863148416:12345-192.168.203.12@tcp:35:dd.500 Request processed in 690us (1674us total) trans 4294967382 rc 0/0 00000100:00100000:1.0:1789760755.758423:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 30 00000020:00080000:1.0:1789760755.758428:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:2.0:1789760755.758620:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760755.845914:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760755.846024:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863148800 00000100:00100000:2.0:1789760755.846037:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863148800 00000100:00100000:2.0:1789760755.846165:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 117 00000100:00100000:2.0:1789760755.846176:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14347fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+11:11060:x1876699863148800:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1789760755.846208:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760755.846247:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3400/0x3e099f5ef04aea35 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d260 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.846689:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2400/0x3e099f5ef04aea3c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.846707:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2400/0x3e099f5ef04aea3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.846734:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2400/0x3e099f5ef04aea3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.846752:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3200/0x3e099f5ef04aea43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.846760:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3200/0x3e099f5ef04aea43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.846767:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3200/0x3e099f5ef04aea43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.846979:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3a00/0x3e099f5ef04aea4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.846988:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3a00/0x3e099f5ef04aea4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.846995:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3a00/0x3e099f5ef04aea4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760755.847006:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x10:0x0]: returning size 0 00010000:00010000:2.0:1789760755.847127:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2400/0x3e099f5ef04aea3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.847135:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2400/0x3e099f5ef04aea3c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.847142:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2400/0x3e099f5ef04aea3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.847148:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2400 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760755.847159:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2400/0x3e099f5ef04aea3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.847167:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2400/0x3e099f5ef04aea3c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.847181:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df2502f3500) 00010000:00010000:2.0:1789760755.847184:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760755.847188:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2400/0x3e099f5ef04aea3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.847195:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2400/0x3e099f5ef04aea3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.847230:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3200/0x3e099f5ef04aea43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.847235:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3200/0x3e099f5ef04aea43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.847241:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3200/0x3e099f5ef04aea43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.847247:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3200 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760755.847250:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3200/0x3e099f5ef04aea43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.847255:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3200/0x3e099f5ef04aea43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.847262:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x572a2e26 (ffff8df250325b00) 00010000:00010000:2.0:1789760755.847264:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760755.847272:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3200/0x3e099f5ef04aea43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.847278:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3200/0x3e099f5ef04aea43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.847330:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3400/0x3e099f5ef04aea35 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d260 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.847342:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3a00/0x3e099f5ef04aea4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d260 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.847349:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df250325600) 00010000:00010000:2.0:1789760755.847352:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789760755.847354:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2517f3a00, rc 0) 00000100:00100000:2.0:1789760755.847436:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14347fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+13:11060:x1876699863148800:12345-192.168.203.12@tcp:101:dd.0 Request processed in 1263us (1538us total) trans 4294967383 rc 0/0 00000100:00100000:2.0:1789760755.847444:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 117 00000100:00100000:0.0:1789760755.864726:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760755.864859:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760755.871085:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760755.874728:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863148928 00000100:00100000:1.0:1789760755.874749:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863148928 00000100:00100000:1.0:1789760755.874866:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863149056 00000100:00100000:1.0:1789760755.874870:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863149056 00000100:00100000:1.0:1789760755.874918:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:1.0:1789760755.874929:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+22:11059:x1876699863148928:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:1.0:1789760755.874953:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760755.874976:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea5f19f5/0x3e099f5ef04aea58 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d267 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.875016:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ead603cd/0x3e099f5ef04ae9e8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d23d expref: 23 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.875026:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789760755.875031:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760755.875036:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea5f19f5/0x3e099f5ef04aea58 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d267 expref: 23 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.875087:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ead603cd/0x3e099f5ef04ae9e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d23d expref: 23 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.875103:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ead603cd/0x3e099f5ef04ae9e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d23d expref: 23 pid: 6693 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760755.875119:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14347c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6694:1876699883053568:192.168.203.12@tcp:104: 00000100:00100000:2.0:1789760755.875480:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:2.0:1789760755.875493:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+23:11062:x1876699863149056:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1789760755.875502:0:8482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760755.875514:0:8482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aea5f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d26e expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.875537:0:8482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a99bef87/0x3e099f5ef04ae9ef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d244 expref: 24 pid: 8482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.875544:0:8482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789760755.875565:0:8482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760755.875569:0:8482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aea5f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d26e expref: 24 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.875596:0:8482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a99bef87/0x3e099f5ef04ae9ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d244 expref: 24 pid: 8482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.875606:0:8482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a99bef87/0x3e099f5ef04ae9ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d244 expref: 24 pid: 8482 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760755.875618:0:8482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8482:1876699883053696:192.168.203.12@tcp:104: 00000100:00100000:3.0:1789760755.879420:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863149184 00000100:00100000:3.0:1789760755.879449:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863149184 00000100:00100000:2.0:1789760755.881476:0:8482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259abfa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789760755.882136:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df27cdbdb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789760755.885443:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760755.885555:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760755.885594:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1789760755.886791:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760755.886990:0:6695:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1789760755.888102:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1789760755.888690:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14347c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6694:1876699883053568:192.168.203.12@tcp:104: 00010000:00010000:0.0:1789760755.888735:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ea5f19f5/0x3e099f5ef04aea58 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d267 expref: 24 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760755.888763:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df25861f200, rc 0) 00000100:00100000:0.0:1789760755.888862:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+24:11059:x1876699863148928:12345-192.168.203.12@tcp:101:dd.0 Request processed in 13934us (24149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760755.888873:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:0.0:1789760755.888912:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863149312 00000100:00100000:0.0:1789760755.888921:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863149312 00000100:00100000:3.0:1789760755.889122:0:8482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8482:1876699883053696:192.168.203.12@tcp:104: 00010000:00010000:3.0:1789760755.889149:0:8482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aea5f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d26e expref: 24 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.889164:0:8482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2517f3400, rc 0) 00000100:00100000:3.0:1789760755.889192:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+24:11062:x1876699863149056:12345-192.168.203.12@tcp:101:dd.0 Request processed in 13704us (24333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760755.889200:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:3.0:1789760755.889234:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863149440 00000100:00100000:3.0:1789760755.889238:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863149440 00000100:00100000:3.0:1789760755.889255:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863149568 00000100:00100000:3.0:1789760755.889258:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863149568 00000100:00100000:3.0:1789760755.889277:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:3.0:1789760755.889285:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d367100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+25:11061:x1876699863149184:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1789760755.889304:0:8482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760755.889324:0:8482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005521a6f5/0x3e099f5ef04aea66 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d275 expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760755.889353:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 77 00010000:00010000:3.0:1789760755.889370:0:8482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789760755.889377:0:8482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760755.889385:0:8482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005521a6f5/0x3e099f5ef04aea66 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d275 expref: 26 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.889397:0:8482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005521a6f5/0x3e099f5ef04aea66 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d275 expref: 26 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.889408:0:8482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df277dbec00, rc 0) 00000100:00100000:3.0:1789760755.889432:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d367100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+26:11061:x1876699863149184:12345-192.168.203.12@tcp:101:dd.0 Request processed in 147us (18365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760755.889439:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:3.0:1789760755.889455:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:3.0:1789760755.889461:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+24:11063:x1876699863149440:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1789760755.889470:0:8482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760755.889480:0:8482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5d2994c/0x3e099f5ef04aea6d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d283 expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.889494:0:8482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789760755.889498:0:8482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760755.889503:0:8482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5d2994c/0x3e099f5ef04aea6d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d283 expref: 25 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.889514:0:8482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b5d2994c/0x3e099f5ef04aea6d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d283 expref: 25 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.889537:0:8482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df277dbe200, rc 0) 00000100:00100000:0.0:1789760755.889538:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d364380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+25:11060:x1876699863149312:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:0.0:1789760755.889550:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760755.889563:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb9133a7/0x3e099f5ef04aea74 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d27c expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760755.889567:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+25:11063:x1876699863149440:12345-192.168.203.12@tcp:101:dd.0 Request processed in 103us (4010us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760755.889582:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:3.0:1789760755.889598:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:3.0:1789760755.889605:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d366a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+26:11058:x1876699863149568:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1789760755.889613:0:8482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760755.889620:0:8482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025a794a9/0x3e099f5ef04aea7b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d28a expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.889635:0:8482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760755.889639:0:8482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760755.889644:0:8482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025a794a9/0x3e099f5ef04aea7b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d28a expref: 27 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.889655:0:8482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000025a794a9/0x3e099f5ef04aea7b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d28a expref: 27 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760755.889660:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760755.889668:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760755.889675:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb9133a7/0x3e099f5ef04aea74 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d27c expref: 27 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.889782:0:8482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df277dbe000, rc 0) 00010000:00010000:0.0:1789760755.889787:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eb9133a7/0x3e099f5ef04aea74 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d27c expref: 27 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760755.889840:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df24627d200, rc 0) 00000100:00100000:3.0:1789760755.889840:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d366a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+27:11058:x1876699863149568:12345-192.168.203.12@tcp:101:dd.0 Request processed in 233us (3051us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760755.889850:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:0.0:1789760755.889872:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d364380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+26:11060:x1876699863149312:12345-192.168.203.12@tcp:101:dd.0 Request processed in 339us (4439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760755.889880:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:2.0:1789760755.889902:0:11800:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 360203090467 time 360003090467 state 0x1 ref 9 00000100:00100000:2.0:1789760755.889922:0:11800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df274bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+25:2349:x1876699863147264:12345-192.168.203.12@tcp:4:dd.500 00000100:00100000:3.0:1789760755.889930:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760755.890160:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863149696 00000100:00100000:2.0:1789760755.890166:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863149696 00010000:00010000:2.0:1789760755.890192:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a99bef87/0x3e099f5ef04ae9ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d244 expref: 25 pid: 8482 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760755.890246:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:2.0:1789760755.890255:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1da0113a-370d-4d79-883c-54efc174697f+25:2348:x1876699863149696:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760755.890266:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789760755.890313:0:6695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_005' 00010000:00010000:2.0:1789760755.890521:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000a99bef87/0x3e099f5ef04ae9ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d244 expref: 25 pid: 8482 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.890552:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a99bef87/0x3e099f5ef04ae9ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d244 expref: 25 pid: 8482 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.890584:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a99bef87/0x3e099f5ef04ae9ef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d244 expref: 25 pid: 8482 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.890599:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760755.890603:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760755.890613:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aea5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d26e expref: 24 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.890624:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aea5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d26e expref: 24 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.890633:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760755.890636:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760755.890641:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5d2994c/0x3e099f5ef04aea6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d283 expref: 24 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.890649:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5d2994c/0x3e099f5ef04aea6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d283 expref: 24 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.890690:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b5d2994c/0x3e099f5ef04aea6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d283 expref: 24 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760755.890721:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2747f8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5829:1876699883053824:192.168.203.12@tcp:105: 00010000:00010000:2.0:1789760755.891593:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aea5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d26e expref: 24 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760755.891610:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25847df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5829:1876699883053952:192.168.203.12@tcp:105: 00000100:00100000:2.0:1789760755.891640:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259abf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789760755.897630:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760755.897673:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760755.897704:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760755.898026:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863149952 00000100:00100000:3.0:1789760755.898056:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863149952 00000100:00100000:3.0:1789760755.898124:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863150080 00000100:00100000:3.0:1789760755.898128:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863150080 00000100:00100000:3.0:1789760755.898160:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:3.0:1789760755.898172:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+27:11068:x1876699863149952:12345-192.168.203.12@tcp:101:dd.0 00000100:00100000:2.0:1789760755.898187:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 81 00010000:00010000:3.0:1789760755.898197:0:8482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1789760755.898203:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d367b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+25:11070:x1876699863150080:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1789760755.898215:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760755.898235:0:8482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000174b77b6/0x3e099f5ef04aea82 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d291 expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.898243:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbb9ed98/0x3e099f5ef04aea89 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d298 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.898277:0:8482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760755.898285:0:8482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760755.898289:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5d2994c/0x3e099f5ef04aea6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d283 expref: 26 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.898294:0:8482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000174b77b6/0x3e099f5ef04aea82 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 7 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d291 expref: 28 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.898309:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760755.898314:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789760755.898320:0:8482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000174b77b6/0x3e099f5ef04aea82 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 7 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d291 expref: 28 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.898322:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbb9ed98/0x3e099f5ef04aea89 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d298 expref: 26 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.898347:0:8482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df277dbee00, rc 0) 00010000:00010000:2.0:1789760755.898385:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b5d2994c/0x3e099f5ef04aea6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d283 expref: 26 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.898414:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b5d2994c/0x3e099f5ef04aea6d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d283 expref: 26 pid: 8482 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760755.898424:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+28:11068:x1876699863149952:12345-192.168.203.12@tcp:101:dd.0 Request processed in 251us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760755.898432:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:2.0:1789760755.898438:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25847c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6694:1876699883054080:192.168.203.12@tcp:104: 00000100:00100000:2.0:1789760755.898512:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259abfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1789760755.898765:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863149824 00000100:00100000:1.0:1789760755.898770:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863149824 00010000:00010000:1.0:1789760755.898794:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ead603cd/0x3e099f5ef04ae9e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d23d expref: 28 pid: 6693 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760755.898848:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:1.0:1789760755.898855:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d365f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1da0113a-370d-4d79-883c-54efc174697f+28:2348:x1876699863149824:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789760755.898867:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760755.898893:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000ead603cd/0x3e099f5ef04ae9e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d23d expref: 28 pid: 6693 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.898906:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ead603cd/0x3e099f5ef04ae9e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d23d expref: 28 pid: 6693 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.898931:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ead603cd/0x3e099f5ef04ae9e8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d23d expref: 28 pid: 6693 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.898947:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760755.898951:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760755.898960:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea5f19f5/0x3e099f5ef04aea58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 7 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d267 expref: 27 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.898971:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea5f19f5/0x3e099f5ef04aea58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 7 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d267 expref: 27 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.898993:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760755.898996:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760755.899002:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005521a6f5/0x3e099f5ef04aea66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 7 type: EXT [3145728->6291455] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d275 expref: 27 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.899010:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005521a6f5/0x3e099f5ef04aea66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 7 type: EXT [3145728->6291455] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d275 expref: 27 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.899016:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760755.899018:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760755.899023:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000025a794a9/0x3e099f5ef04aea7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 7 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d28a expref: 27 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.899031:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025a794a9/0x3e099f5ef04aea7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 7 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d28a expref: 27 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.899038:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760755.899041:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760755.899046:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb9133a7/0x3e099f5ef04aea74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d27c expref: 27 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.899054:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb9133a7/0x3e099f5ef04aea74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d27c expref: 27 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.899060:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760755.899070:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760755.899075:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000174b77b6/0x3e099f5ef04aea82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 7 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d291 expref: 27 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.899083:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000174b77b6/0x3e099f5ef04aea82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 7 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d291 expref: 27 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.899111:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000174b77b6/0x3e099f5ef04aea82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 7 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d291 expref: 27 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760755.899123:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14347ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5830:1876699883054208:192.168.203.12@tcp:105: 00010000:00010000:1.0:1789760755.899190:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000eb9133a7/0x3e099f5ef04aea74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d27c expref: 27 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760755.899201:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14347df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5830:1876699883054336:192.168.203.12@tcp:105: 00010000:00010000:1.0:1789760755.899243:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000025a794a9/0x3e099f5ef04aea7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 7 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d28a expref: 27 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760755.899253:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14347f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5830:1876699883054464:192.168.203.12@tcp:105: 00010000:00010000:1.0:1789760755.899299:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005521a6f5/0x3e099f5ef04aea66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 7 type: EXT [3145728->6291455] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d275 expref: 27 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760755.899310:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14347c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5830:1876699883054592:192.168.203.12@tcp:105: 00010000:00010000:1.0:1789760755.899336:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ea5f19f5/0x3e099f5ef04aea58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 7 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d267 expref: 27 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760755.899353:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc46d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5830:1876699883054720:192.168.203.12@tcp:105: 00000100:00100000:1.0:1789760755.899373:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df27cdbd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760755.899484:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760755.899517:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863150208 00000100:00100000:1.0:1789760755.899523:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863150208 00000100:00100000:1.0:1789760755.899563:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:1.0:1789760755.899572:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+27:11064:x1876699863150208:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:1.0:1789760755.899724:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760755.899741:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfd0c19c/0x3e099f5ef04aea90 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d29f expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.899762:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789760755.899766:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1789760755.899772:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfd0c19c/0x3e099f5ef04aea90 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d29f expref: 28 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.899781:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bfd0c19c/0x3e099f5ef04aea90 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d29f expref: 28 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.899792:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df25861e600, rc 0) 00000100:00100000:1.0:1789760755.899847:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+28:11064:x1876699863150208:12345-192.168.203.12@tcp:101:dd.0 Request processed in 276us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760755.899853:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:2.0:1789760755.913022:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760755.913062:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760755.913084:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760755.913126:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760755.913178:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863150336 00000100:00100000:2.0:1789760755.913186:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863150336 00000100:00100000:2.0:1789760755.913245:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863150464 00000100:00100000:2.0:1789760755.913249:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863150464 00000100:00100000:2.0:1789760755.913262:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863150592 00000100:00100000:2.0:1789760755.913264:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863150592 00000100:00100000:2.0:1789760755.913273:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863150720 00000100:00100000:2.0:1789760755.913275:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863150720 00000100:00100000:3.0:1789760755.913507:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:3.0:1789760755.913525:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+28:11069:x1876699863150336:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1789760755.913545:0:8482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760755.913569:0:8482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c3aa1b0/0x3e099f5ef04aea97 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d2a6 expref: -99 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760755.913619:0:12460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 84 00010000:00010000:3.0:1789760755.913628:0:8482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000174b77b6/0x3e099f5ef04aea82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 8 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d291 expref: 29 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.913643:0:8482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1789760755.913645:0:12460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1da0113a-370d-4d79-883c-54efc174697f+30:11065:x1876699863150464:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1789760755.913662:0:8482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789760755.913668:0:12460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760755.913671:0:8482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c3aa1b0/0x3e099f5ef04aea97 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 8 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2a6 expref: 29 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760755.913690:0:12460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000996d94d0/0x3e099f5ef04aea9e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d2ad expref: -99 pid: 12460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.913717:0:8482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000174b77b6/0x3e099f5ef04aea82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 8 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d291 expref: 29 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760755.913725:0:12460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1789760755.913733:0:12460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(3 0) 00010000:00010000:3.0:1789760755.913735:0:8482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000174b77b6/0x3e099f5ef04aea82 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 8 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d291 expref: 29 pid: 8482 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760755.913743:0:12460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000996d94d0/0x3e099f5ef04aea9e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2ad expref: 31 pid: 12460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760755.913781:0:12460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000996d94d0/0x3e099f5ef04aea9e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2ad expref: 31 pid: 12460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760755.913783:0:8482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d3f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8482:1876699883054848:192.168.203.12@tcp:104: 00010000:00010000:0.0:1789760755.913839:0:12460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df24627d800, rc 0) 00000100:00100000:0.0:1789760755.913902:0:12460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1da0113a-370d-4d79-883c-54efc174697f+31:11065:x1876699863150464:12345-192.168.203.12@tcp:101:dd.0 Request processed in 266us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760755.913926:0:12460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:0.0:1789760755.913954:0:12460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:0.0:1789760755.913960:0:12460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1da0113a-370d-4d79-883c-54efc174697f+30:11071:x1876699863150592:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:0.0:1789760755.913967:0:12460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760755.913974:0:12460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d571eff3/0x3e099f5ef04aeaa5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d2b4 expref: -99 pid: 12460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760755.913988:0:12460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(3 0) 00010000:00010000:0.0:1789760755.913991:0:12460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(4 0) 00010000:00010000:0.0:1789760755.913996:0:12460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d571eff3/0x3e099f5ef04aeaa5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 8 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2b4 expref: 31 pid: 12460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760755.914005:0:12460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d571eff3/0x3e099f5ef04aeaa5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 8 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2b4 expref: 31 pid: 12460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760755.914013:0:12460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df24627c200, rc 0) 00000100:00100000:0.0:1789760755.914031:0:12460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1da0113a-370d-4d79-883c-54efc174697f+31:11071:x1876699863150592:12345-192.168.203.12@tcp:101:dd.0 Request processed in 72us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760755.914038:0:12460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:2.0:1789760755.914452:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:2.0:1789760755.914468:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+30:11072:x1876699863150720:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1789760755.914482:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760755.914499:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029ef3a94/0x3e099f5ef04aeaac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d2bb expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.914524:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(4 0) 00010000:00010000:2.0:1789760755.914529:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(5 0) 00010000:00010000:2.0:1789760755.914534:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029ef3a94/0x3e099f5ef04aeaac lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2bb expref: 31 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.914560:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000029ef3a94/0x3e099f5ef04aeaac lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2bb expref: 31 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760755.914574:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2517f2400, rc 0) 00000100:00100000:2.0:1789760755.914637:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+31:11072:x1876699863150720:12345-192.168.203.12@tcp:101:dd.0 Request processed in 174us (1513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760755.914643:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:3.0:1789760755.915046:0:8482:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df27cdb4300 going to sleep for 11 seconds 00000100:00100000:1.0:1789760755.915303:0:11800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df274bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+30:2349:x1876699863147264:12345-192.168.203.12@tcp:4:dd.500 Request processed in 25380us (555839us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1789760755.915329:0:11800:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 9 00002000:00100000:1.0:1789760755.915345:0:11800:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x5:0x0] (3145728->4194303) req@ffff8df274bc0a80 x1876699863147264/t4294967332(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:46/0 lens 488/448 e 0 to 0 dl 1789760766 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789760755.915356:0:11800:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df274bc0a80 with x1876699863147264 ext(3145728->4194303) 00002000:00010000:1.0:1789760755.915363:0:11800:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df274bc0a80 00000100:00100000:2.0:1789760755.915888:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760755.917453:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863150848 00000100:00100000:1.0:1789760755.917469:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863150848 00000100:00100000:1.0:1789760755.917619:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:1.0:1789760755.917632:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d031500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+30:11066:x1876699863150848:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:1.0:1789760755.917655:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760755.917678:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046a49a68/0x3e099f5ef04aeab3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d2c2 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.917720:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005521a6f5/0x3e099f5ef04aea66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 9 type: EXT [3145728->6291455] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d275 expref: 31 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.917730:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789760755.917735:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1789760755.917741:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046a49a68/0x3e099f5ef04aeab3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 9 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2c2 expref: 31 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.917790:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005521a6f5/0x3e099f5ef04aea66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 9 type: EXT [3145728->6291455] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d275 expref: 31 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.917840:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005521a6f5/0x3e099f5ef04aea66 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 9 type: EXT [3145728->6291455] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d275 expref: 31 pid: 8482 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760755.917875:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6695:1876699883054976:192.168.203.12@tcp:104: 00000100:00100000:1.0:1789760755.917978:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df27cdbd240 going to sleep for 11 seconds 00010000:00010000:3.0:1789760755.920844:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760755.925678:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14347c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5830:1876699883054592:192.168.203.12@tcp:105: 00000100:00100000:0.0:1789760755.926530:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2747f8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5829:1876699883053824:192.168.203.12@tcp:105: 00000100:00100000:2.0:1789760755.933017:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760755.933085:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863150976 00000100:00100000:1.0:1789760755.933093:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863150976 00000100:00100000:3.0:1789760755.933185:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25847c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6694:1876699883054080:192.168.203.12@tcp:104: 00010000:00010000:3.0:1789760755.933229:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cbb9ed98/0x3e099f5ef04aea89 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 9 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d298 expref: 31 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.933248:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2517f3200, rc 0) 00000100:00100000:0.0:1789760755.933379:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25847df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5829:1876699883053952:192.168.203.12@tcp:105: 00010000:00010000:0.0:1789760755.933415:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1789760755.933526:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (1048576->2097151) req@ffff8df27d030a80 x1876699863150976/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:46/0 lens 488/0 e 0 to 0 dl 1789760766 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789760755.933540:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27d030a80 with x1876699863150976 ext(1048576->2097151) 00010000:00010000:1.0:1789760755.933548:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b5d2994c/0x3e099f5ef04aea6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 8 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d283 expref: 31 pid: 8482 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.933559:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b5d2994c/0x3e099f5ef04aea6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 8 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d283 expref: 31 pid: 8482 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760755.933566:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8df27d030a80 00000100:00100000:1.0:1789760755.933590:0:6700:0:(nrs_tbf.c:1321:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff8df261ee9400 key gid={0} rule@0xffff8df274bf2100 gen 0 rate 10000 depth 3 token 3 deadline 0 time 360046782676 state 0x0 ref 1 00000100:00100000:1.0:1789760755.933601:0:6700:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df261ee9400 key gid={0} rule@0xffff8df274bf2100 gen 0 rate 10000 depth 3 token 3 deadline 360046882676 time 360046782676 state 0x1 ref 1 00000100:00100000:1.0:1789760755.933629:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df261ee9400 key gid={0} rule@0xffff8df274bf2100 gen 0 rate 10000 depth 3 token 2 deadline 360046882676 time 360046824910 state 0x0 ref 1 00000100:00100000:1.0:1789760755.933642:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+31:2350:x1876699863150976:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:0.0:1789760755.935016:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14347ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5830:1876699883054208:192.168.203.12@tcp:105: 00000100:00100000:3.0:1789760755.935017:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d367b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+31:11070:x1876699863150080:12345-192.168.203.12@tcp:101:dd.0 Request processed in 36807us (37298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760755.935046:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14347df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5830:1876699883054336:192.168.203.12@tcp:105: 00000100:00100000:3.0:1789760755.935055:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:0.0:1789760755.935086:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14347f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5830:1876699883054464:192.168.203.12@tcp:105: 00000100:00100000:0.0:1789760755.935104:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc46d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5830:1876699883054720:192.168.203.12@tcp:105: 00000100:00100000:3.0:1789760755.935133:0:8482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d3f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8482:1876699883054848:192.168.203.12@tcp:104: 00010000:00010000:3.0:1789760755.935163:0:8482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008c3aa1b0/0x3e099f5ef04aea97 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 9 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2a6 expref: 31 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.935182:0:8482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df277dbe600, rc 0) 00000100:00100000:3.0:1789760755.935209:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1da0113a-370d-4d79-883c-54efc174697f+31:11069:x1876699863150336:12345-192.168.203.12@tcp:101:dd.0 Request processed in 21691us (22198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760755.935216:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 83 00010000:00010000:0.0:1789760755.935276:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760755.935338:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d365f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1da0113a-370d-4d79-883c-54efc174697f+30:2348:x1876699863149824:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 36480us (37720us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760755.935350:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:0.0:1789760755.935410:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6695:1876699883054976:192.168.203.12@tcp:104: 00010000:00010000:0.0:1789760755.935430:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000046a49a68/0x3e099f5ef04aeab3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 8 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2c2 expref: 29 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760755.935450:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df25861ea00, rc 0) 00000100:00100000:0.0:1789760755.935474:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d031500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+29:11066:x1876699863150848:12345-192.168.203.12@tcp:101:dd.0 Request processed in 17846us (19591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760755.935481:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:0.0:1789760755.935541:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1da0113a-370d-4d79-883c-54efc174697f+30:2348:x1876699863149696:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 45286us (45615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760755.935550:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:2.0:1789760755.946898:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760755.946966:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863151104 00000100:00100000:0.0:1789760755.946984:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863151104 00000100:00100000:0.0:1789760755.947077:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:0.0:1789760755.947090:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d033800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+31:11073:x1876699863151104:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:0.0:1789760755.947115:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760755.947339:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aeaba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d2c9 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760755.947408:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(5 0) 00010000:00010000:0.0:1789760755.947416:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(6 0) 00010000:00010000:0.0:1789760755.947424:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aeaba lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 9 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2c9 expref: 32 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760755.947440:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aeaba lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 9 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2c9 expref: 32 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760755.947456:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df24627d400, rc 0) 00000100:00100000:0.0:1789760755.947597:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d033800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+32:11073:x1876699863151104:12345-192.168.203.12@tcp:101:dd.0 Request processed in 509us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760755.947618:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:1.0:1789760755.963986:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+32:2350:x1876699863150976:12345-192.168.203.12@tcp:4:dd.0 Request processed in 30337us (30967us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1789760755.964013:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:1.0:1789760755.964022:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df261ee9400 key gid={0} rule@0xffff8df274bf2100 gen 0 rate 10000 depth 3 token 2 deadline 360046882676 time 360046824910 state 0x2 ref 0 00002000:00100000:1.0:1789760755.964038:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (1048576->2097151) req@ffff8df27d030a80 x1876699863150976/t4294967435(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:46/0 lens 488/448 e 0 to 0 dl 1789760766 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789760755.964047:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27d030a80 with x1876699863150976 ext(1048576->2097151) 00010000:00010000:1.0:1789760755.964058:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b5d2994c/0x3e099f5ef04aea6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 9 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d283 expref: 32 pid: 8482 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760755.964073:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b5d2994c/0x3e099f5ef04aea6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 9 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d283 expref: 32 pid: 8482 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760755.964080:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8df27d030a80 00000100:00100000:3.0:1789760755.967638:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760755.967730:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863151232 00000100:00100000:0.0:1789760755.967740:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863151232 00002000:00100000:0.0:1789760755.967785:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (6291456->7340031) req@ffff8df26d3f7480 x1876699863151232/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:46/0 lens 488/0 e 0 to 0 dl 1789760766 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760755.967797:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df26d3f7480 with x1876699863151232 ext(6291456->7340031) 00010000:00010000:0.0:1789760755.967832:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000174b77b6/0x3e099f5ef04aea82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 8 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d291 expref: 29 pid: 8482 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760755.967849:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000174b77b6/0x3e099f5ef04aea82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 8 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d291 expref: 29 pid: 8482 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760755.967857:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8df26d3f7480 00000100:00100000:0.0:1789760755.967880:0:6699:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df261ee9400 key gid={0} rule@0xffff8df274bf2100 gen 0 rate 10000 depth 3 token 2 deadline 360046882676 time 360046824910 state 0x0 ref 1 00000100:00100000:0.0:1789760755.967891:0:6699:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df261ee9400 key gid={0} rule@0xffff8df274bf2100 gen 0 rate 10000 depth 3 token 2 deadline 360046924910 time 360046824910 state 0x1 ref 1 00000100:00100000:0.0:1789760755.967918:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df261ee9400 key gid={0} rule@0xffff8df274bf2100 gen 0 rate 10000 depth 3 token 2 deadline 360046924910 time 360081113635 state 0x0 ref 1 00000100:00100000:0.0:1789760755.967931:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+29:2351:x1876699863151232:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:0.0:1789760755.975605:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760755.975743:0:7645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863151360 00000100:00100000:3.0:1789760755.975753:0:7645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863151360 00010000:00010000:3.0:1789760755.975829:0:7645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b5d2994c/0x3e099f5ef04aea6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 9 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d283 expref: 32 pid: 8482 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760755.975874:0:7645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:3.0:1789760755.975885:0:7645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d365500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1da0113a-370d-4d79-883c-54efc174697f+32:2351:x1876699863151360:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789760755.975899:0:7645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789760755.975918:0:7645:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:3.0:1789760755.975921:0:7645:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1789760753 -> 1789760755 00002000:00010000:3.0:1789760755.975924:0:7645:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789760753 -> 1789760755 00010000:00010000:3.0:1789760755.975931:0:7645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b5d2994c/0x3e099f5ef04aea6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 10 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d283 expref: 32 pid: 8482 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.975963:0:7645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b5d2994c/0x3e099f5ef04aea6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 10 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d283 expref: 32 pid: 8482 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.975986:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5d2994c/0x3e099f5ef04aea6d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 10 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d283 expref: 32 pid: 8482 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.976002:0:7645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(6 0) 00010000:00010000:3.0:1789760755.976007:0:7645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(6 0) 00010000:00010000:3.0:1789760755.976016:0:7645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cbb9ed98/0x3e099f5ef04aea89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 9 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d298 expref: 31 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.976026:0:7645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbb9ed98/0x3e099f5ef04aea89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 9 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d298 expref: 31 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.976035:0:7645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(6 0) 00010000:00010000:3.0:1789760755.976038:0:7645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(6 0) 00010000:00010000:3.0:1789760755.976044:0:7645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfd0c19c/0x3e099f5ef04aea90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d29f expref: 31 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.976052:0:7645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfd0c19c/0x3e099f5ef04aea90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d29f expref: 31 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.976060:0:7645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(6 0) 00010000:00010000:3.0:1789760755.976063:0:7645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(6 0) 00010000:00010000:3.0:1789760755.976068:0:7645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000996d94d0/0x3e099f5ef04aea9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2ad expref: 31 pid: 12460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.976082:0:7645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000996d94d0/0x3e099f5ef04aea9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2ad expref: 31 pid: 12460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.976090:0:7645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(6 0) 00010000:00010000:3.0:1789760755.976093:0:7645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(6 0) 00010000:00010000:3.0:1789760755.976098:0:7645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d571eff3/0x3e099f5ef04aeaa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2b4 expref: 31 pid: 12460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.976106:0:7645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d571eff3/0x3e099f5ef04aeaa5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2b4 expref: 31 pid: 12460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.976113:0:7645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(6 0) 00010000:00010000:3.0:1789760755.976116:0:7645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(6 0) 00010000:00010000:3.0:1789760755.976121:0:7645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000029ef3a94/0x3e099f5ef04aeaac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2bb expref: 31 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.976130:0:7645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029ef3a94/0x3e099f5ef04aeaac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2bb expref: 31 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.976138:0:7645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(6 0) 00010000:00010000:3.0:1789760755.976140:0:7645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(6 0) 00010000:00010000:3.0:1789760755.976145:0:7645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aeaba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2c9 expref: 31 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.976154:0:7645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aeaba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2c9 expref: 31 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760755.976195:0:7645:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aeaba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 9 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2c9 expref: 31 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760755.976209:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25847df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7645:1876699883055104:192.168.203.12@tcp:105: 00010000:00010000:3.0:1789760755.976306:0:7645:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000029ef3a94/0x3e099f5ef04aeaac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 9 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2bb expref: 31 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760755.976316:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df25847c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7645:1876699883055232:192.168.203.12@tcp:105: 00010000:00010000:3.0:1789760755.976346:0:7645:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d571eff3/0x3e099f5ef04aeaa5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 9 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2b4 expref: 31 pid: 12460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760755.976356:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e2f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7645:1876699883055360:192.168.203.12@tcp:105: 00010000:00010000:3.0:1789760755.976382:0:7645:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000996d94d0/0x3e099f5ef04aea9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2ad expref: 31 pid: 12460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760755.976391:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e2df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7645:1876699883055488:192.168.203.12@tcp:105: 00010000:00010000:3.0:1789760755.976417:0:7645:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bfd0c19c/0x3e099f5ef04aea90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d29f expref: 31 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760755.976426:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e2fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7645:1876699883055616:192.168.203.12@tcp:105: 00010000:00010000:3.0:1789760755.976578:0:7645:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cbb9ed98/0x3e099f5ef04aea89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 9 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d298 expref: 31 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760755.976601:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df258e2d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7645:1876699883055744:192.168.203.12@tcp:105: 00000100:00100000:3.0:1789760755.976623:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df27cdb4300 going to sleep for 11 seconds 00000100:00100000:2.0:1789760755.981493:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760755.981642:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863151488 00000100:00100000:1.0:1789760755.981651:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863151488 00002000:00100000:1.0:1789760755.981711:0:11801:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x6:0x0] (2097152->3145727) req@ffff8df258559180 x1876699863151488/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:46/0 lens 488/0 e 0 to 0 dl 1789760766 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789760755.981721:0:11801:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df258559180 with x1876699863151488 ext(2097152->3145727) 00002000:00010000:1.0:1789760755.981727:0:11801:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df258559180 00000100:00100000:1.0:1789760755.981746:0:11801:0:(nrs_tbf.c:1321:nrs_tbf_cli_findadd()) unknown.0 NRS: TBF class insert: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 3 deadline 0 time 360094939030 state 0x0 ref 1 00000100:00100000:1.0:1789760755.981759:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 3 deadline 360095039030 time 360094939030 state 0x1 ref 1 00000100:00100000:1.0:1789760755.981916:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 2 deadline 360095039030 time 360095110213 state 0x0 ref 1 00000100:00100000:1.0:1789760755.981930:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258559180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+31:2349:x1876699863151488:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:3.0:1789760755.989761:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25847df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7645:1876699883055104:192.168.203.12@tcp:105: 00000100:00100000:3.0:1789760755.989775:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df25847c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7645:1876699883055232:192.168.203.12@tcp:105: 00000100:00100000:3.0:1789760755.989782:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258e2f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7645:1876699883055360:192.168.203.12@tcp:105: 00000100:00100000:3.0:1789760755.989790:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258e2df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7645:1876699883055488:192.168.203.12@tcp:105: 00000100:00100000:3.0:1789760755.989836:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258e2fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7645:1876699883055616:192.168.203.12@tcp:105: 00000100:00100000:3.0:1789760755.989843:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df258e2d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7645:1876699883055744:192.168.203.12@tcp:105: 00010000:00010000:3.0:1789760755.989874:0:7645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760755.989931:0:7645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d365500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1da0113a-370d-4d79-883c-54efc174697f+31:2351:x1876699863151360:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 14048us (14335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760755.989941:0:7645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:1.0:1789760756.002508:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258559180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+34:2349:x1876699863151488:12345-192.168.203.12@tcp:4:dd.0 Request processed in 20571us (21013us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1789760756.002523:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:1.0:1789760756.002531:0:11796:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 2 deadline 360095039030 time 360095110213 state 0x2 ref 0 00002000:00100000:1.0:1789760756.002546:0:11796:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (2097152->3145727) req@ffff8df258559180 x1876699863151488/t4294967334(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:46/0 lens 488/448 e 0 to 0 dl 1789760766 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789760756.002555:0:11796:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df258559180 with x1876699863151488 ext(2097152->3145727) 00002000:00010000:1.0:1789760756.002561:0:11796:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df258559180 00000100:00100000:0.0:1789760756.002903:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+33:2351:x1876699863151232:12345-192.168.203.12@tcp:4:dd.0 Request processed in 34973us (35272us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1789760756.002911:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:0.0:1789760756.002916:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df261ee9400 key gid={0} rule@0xffff8df274bf2100 gen 0 rate 10000 depth 3 token 2 deadline 360046924910 time 360081113635 state 0x2 ref 0 00002000:00100000:0.0:1789760756.002925:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (6291456->7340031) req@ffff8df26d3f7480 x1876699863151232/t4294967333(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:46/0 lens 488/448 e 0 to 0 dl 1789760766 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760756.002933:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df26d3f7480 with x1876699863151232 ext(6291456->7340031) 00010000:00010000:0.0:1789760756.002942:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000174b77b6/0x3e099f5ef04aea82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 8 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d291 expref: 33 pid: 8482 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.002956:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000174b77b6/0x3e099f5ef04aea82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 8 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d291 expref: 33 pid: 8482 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760756.002964:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8df26d3f7480 00000100:00100000:1.0:1789760756.014586:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760756.016335:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760756.016414:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760756.016475:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863151872 00000100:00100000:0.0:1789760756.016486:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863151872 00010000:00010000:0.0:1789760756.016555:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000174b77b6/0x3e099f5ef04aea82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 8 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d291 expref: 33 pid: 8482 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760756.016607:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:0.0:1789760756.016617:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1da0113a-370d-4d79-883c-54efc174697f+33:2351:x1876699863151872:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789760756.016631:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789760756.016655:0:5830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 7340032 00002000:00010000:0.0:1789760756.016658:0:5830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789760753 -> 1789760755 00002000:00010000:0.0:1789760756.016661:0:5830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789760753 -> 1789760755 00010000:00010000:0.0:1789760756.016666:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000174b77b6/0x3e099f5ef04aea82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 9 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d291 expref: 33 pid: 8482 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.016678:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000174b77b6/0x3e099f5ef04aea82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 9 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d291 expref: 33 pid: 8482 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.016701:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000174b77b6/0x3e099f5ef04aea82 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 9 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d291 expref: 33 pid: 8482 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.016717:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1789760756.016721:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1789760756.016728:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008c3aa1b0/0x3e099f5ef04aea97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 8 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2a6 expref: 32 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.016737:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c3aa1b0/0x3e099f5ef04aea97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 8 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2a6 expref: 32 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.016772:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008c3aa1b0/0x3e099f5ef04aea97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 8 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2a6 expref: 32 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760756.016792:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14347f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5830:1876699883055872:192.168.203.12@tcp:105: 00000100:00100000:0.0:1789760756.016896:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df24574dd80 going to sleep for 11 seconds 00000100:00080000:1.0:1789760756.017065:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789760756.017768:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863151616 00000100:00100000:2.0:1789760756.017774:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863151616 00002000:00100000:3.0:1789760756.017882:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (5242880->6291455) req@ffff8df27cc44700 x1876699863151616/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:47/0 lens 488/0 e 0 to 0 dl 1789760767 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760756.017892:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cc44700 with x1876699863151616 ext(5242880->6291455) 00010000:00010000:3.0:1789760756.017899:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005521a6f5/0x3e099f5ef04aea66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 8 type: EXT [3145728->6291455] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d275 expref: 33 pid: 8482 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.017913:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005521a6f5/0x3e099f5ef04aea66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 8 type: EXT [3145728->6291455] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d275 expref: 33 pid: 8482 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760756.017927:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8df27cc44700 00000100:00100000:3.0:1789760756.017938:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df261ee9400 key gid={0} rule@0xffff8df274bf2100 gen 0 rate 10000 depth 3 token 2 deadline 360046924910 time 360081113635 state 0x0 ref 1 00000100:00100000:3.0:1789760756.017947:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df261ee9400 key gid={0} rule@0xffff8df274bf2100 gen 0 rate 10000 depth 3 token 2 deadline 360081213635 time 360081113635 state 0x1 ref 1 00000100:00100000:3.0:1789760756.017974:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863151744 00000100:00100000:3.0:1789760756.017977:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863151744 00002000:00100000:3.0:1789760756.017991:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (1048576->2097151) req@ffff8df258e2fb80 x1876699863151744/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:47/0 lens 488/0 e 0 to 0 dl 1789760767 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760756.018000:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df258e2fb80 with x1876699863151744 ext(1048576->2097151) 00002000:00010000:3.0:1789760756.018003:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df258e2fb80 00000100:00100000:3.0:1789760756.018009:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 2 deadline 360095039030 time 360095110213 state 0x0 ref 1 00000100:00100000:3.0:1789760756.018039:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 2 deadline 360095210213 time 360095110213 state 0x1 ref 1 00000100:00100000:3.0:1789760756.018061:0:11797:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df261ee9400 key gid={0} rule@0xffff8df274bf2100 gen 0 rate 10000 depth 3 token 2 deadline 360081213635 time 360131255885 state 0x0 ref 1 00000100:00100000:3.0:1789760756.018071:0:11797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+34:2349:x1876699863151616:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:3.0:1789760756.018201:0:6698:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 2 deadline 360095210213 time 360131396125 state 0x0 ref 1 00000100:00100000:3.0:1789760756.018210:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+35:2349:x1876699863151744:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:0.0:1789760756.032323:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760756.032417:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863152000 00000100:00100000:2.0:1789760756.032427:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863152000 00002000:00100000:2.0:1789760756.032472:0:11801:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x6:0x0] (0->1048575) req@ffff8df14347df80 x1876699863152000/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:47/0 lens 488/0 e 0 to 0 dl 1789760767 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760756.032484:0:11801:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df14347df80 with x1876699863152000 ext(0->1048575) 00002000:00010000:2.0:1789760756.032489:0:11801:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df14347df80 00000100:00100000:2.0:1789760756.032538:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 2 deadline 360131496125 time 360131396125 state 0x1 ref 2 00000100:00100000:2.0:1789760756.032559:0:11801:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 2 deadline 360131496125 time 360145754192 state 0x0 ref 2 00000100:00100000:2.0:1789760756.032572:0:11801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14347df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+37:2348:x1876699863152000:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:0.0:1789760756.033936:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14347f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5830:1876699883055872:192.168.203.12@tcp:105: 00010000:00010000:0.0:1789760756.033962:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760756.034026:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1da0113a-370d-4d79-883c-54efc174697f+37:2351:x1876699863151872:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 17409us (17695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760756.034036:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:1.0:1789760756.044555:0:11797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+38:2349:x1876699863151616:12345-192.168.203.12@tcp:4:dd.0 Request processed in 26473us (29966us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1789760756.044570:0:11797:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:1.0:1789760756.044578:0:11797:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df261ee9400 key gid={0} rule@0xffff8df274bf2100 gen 0 rate 10000 depth 3 token 2 deadline 360081213635 time 360131255885 state 0x2 ref 0 00002000:00100000:1.0:1789760756.044595:0:11797:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (5242880->6291455) req@ffff8df27cc44700 x1876699863151616/t4294967335(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:47/0 lens 488/448 e 0 to 0 dl 1789760767 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789760756.044605:0:11797:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cc44700 with x1876699863151616 ext(5242880->6291455) 00010000:00010000:1.0:1789760756.044617:0:11797:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005521a6f5/0x3e099f5ef04aea66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 7 type: EXT [3145728->6291455] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d275 expref: 38 pid: 8482 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.044636:0:11797:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005521a6f5/0x3e099f5ef04aea66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 7 type: EXT [3145728->6291455] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d275 expref: 38 pid: 8482 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760756.044661:0:11797:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8df27cc44700 00000100:00100000:3.0:1789760756.044960:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760756.045241:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863152128 00000100:00100000:0.0:1789760756.045249:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863152128 00002000:00100000:0.0:1789760756.045286:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (3145728->4194303) req@ffff8df258e2df80 x1876699863152128/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:47/0 lens 488/0 e 0 to 0 dl 1789760767 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760756.045294:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df258e2df80 with x1876699863152128 ext(3145728->4194303) 00010000:00010000:0.0:1789760756.045299:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005521a6f5/0x3e099f5ef04aea66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 7 type: EXT [3145728->6291455] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d275 expref: 38 pid: 8482 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.045309:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005521a6f5/0x3e099f5ef04aea66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 7 type: EXT [3145728->6291455] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d275 expref: 38 pid: 8482 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760756.045315:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8df258e2df80 00000100:00100000:0.0:1789760756.045324:0:6699:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df261ee9400 key gid={0} rule@0xffff8df274bf2100 gen 0 rate 10000 depth 3 token 2 deadline 360081213635 time 360131255885 state 0x0 ref 1 00000100:00100000:0.0:1789760756.045333:0:6699:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df261ee9400 key gid={0} rule@0xffff8df274bf2100 gen 0 rate 10000 depth 3 token 2 deadline 360131355885 time 360131255885 state 0x1 ref 1 00000100:00100000:0.0:1789760756.045354:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df261ee9400 key gid={0} rule@0xffff8df274bf2100 gen 0 rate 10000 depth 3 token 2 deadline 360131355885 time 360158549126 state 0x0 ref 1 00000100:00100000:0.0:1789760756.045373:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+38:2349:x1876699863152128:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:3.0:1789760756.045902:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760756.045951:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863152256 00000100:00100000:1.0:1789760756.045956:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863152256 00002000:00100000:1.0:1789760756.045993:0:11799:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x6:0x0] (6291456->7340031) req@ffff8df258e2f480 x1876699863152256/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:47/0 lens 488/0 e 0 to 0 dl 1789760767 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789760756.046002:0:11799:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df258e2f480 with x1876699863152256 ext(6291456->7340031) 00002000:00010000:1.0:1789760756.046005:0:11799:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df258e2f480 00000100:00100000:1.0:1789760756.046037:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 2 deadline 360145854192 time 360145754192 state 0x1 ref 3 00000100:00100000:1.0:1789760756.046053:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 2 deadline 360145854192 time 360159249240 state 0x0 ref 3 00000100:00100000:1.0:1789760756.046063:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+31:2348:x1876699863152256:12345-192.168.203.12@tcp:4:dd.0 00000100:00080000:1.0:1789760756.046182:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760756.046632:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+40:2349:x1876699863151744:12345-192.168.203.12@tcp:4:dd.0 Request processed in 28420us (30215us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1789760756.046653:0:6698:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 19 00002000:00100000:3.0:1789760756.046662:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (1048576->2097151) req@ffff8df258e2fb80 x1876699863151744/t4294967336(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:47/0 lens 488/448 e 0 to 0 dl 1789760767 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760756.046671:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df258e2fb80 with x1876699863151744 ext(1048576->2097151) 00002000:00010000:3.0:1789760756.046676:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df258e2fb80 00000100:00100000:0.0:1789760756.047726:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760756.047923:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863152384 00000100:00100000:3.0:1789760756.047930:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863152384 00002000:00100000:3.0:1789760756.047961:0:11796:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (7340032->8388607) req@ffff8df14347f480 x1876699863152384/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:47/0 lens 488/0 e 0 to 0 dl 1789760767 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760756.047972:0:11796:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df14347f480 with x1876699863152384 ext(7340032->8388607) 00002000:00010000:3.0:1789760756.047976:0:11796:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df14347f480 00000100:00100000:3.0:1789760756.048009:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 2 deadline 360159349240 time 360159249240 state 0x1 ref 3 00000100:00100000:3.0:1789760756.048028:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 2 deadline 360159349240 time 360161223553 state 0x0 ref 3 00000100:00100000:3.0:1789760756.048038:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14347f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+33:2349:x1876699863152384:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:1.0:1789760756.055321:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760756.055425:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863152512 00000100:00100000:2.0:1789760756.055969:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863152512 00002000:00100000:2.0:1789760756.056018:0:11800:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x6:0x0] (4194304->5242879) req@ffff8df27cc45180 x1876699863152512/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:47/0 lens 488/0 e 0 to 0 dl 1789760767 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760756.056030:0:11800:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cc45180 with x1876699863152512 ext(4194304->5242879) 00002000:00010000:2.0:1789760756.056036:0:11800:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df27cc45180 00000100:00100000:2.0:1789760756.056075:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 2 deadline 360161323553 time 360161223553 state 0x1 ref 4 00000100:00100000:2.0:1789760756.056099:0:11800:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 2 deadline 360161323553 time 360169294004 state 0x0 ref 4 00000100:00100000:2.0:1789760756.056112:0:11800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+35:2348:x1876699863152512:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:3.0:1789760756.057293:0:11801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14347df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+40:2348:x1876699863152000:12345-192.168.203.12@tcp:4:dd.0 Request processed in 24719us (24974us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1789760756.057304:0:11801:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 20 00002000:00100000:3.0:1789760756.057314:0:11801:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x6:0x0] (0->1048575) req@ffff8df14347df80 x1876699863152000/t4294967337(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:47/0 lens 488/448 e 0 to 0 dl 1789760767 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789760756.057323:0:11801:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df14347df80 with x1876699863152000 ext(0->1048575) 00002000:00010000:3.0:1789760756.057328:0:11801:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df14347df80 00000100:00100000:2.0:1789760756.070066:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+40:2349:x1876699863152128:12345-192.168.203.12@tcp:4:dd.0 Request processed in 24684us (25097us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1789760756.070082:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:2.0:1789760756.070091:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df261ee9400 key gid={0} rule@0xffff8df274bf2100 gen 0 rate 10000 depth 3 token 2 deadline 360131355885 time 360158549126 state 0x2 ref 0 00002000:00100000:2.0:1789760756.070107:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (3145728->4194303) req@ffff8df258e2df80 x1876699863152128/t4294967338(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:47/0 lens 488/448 e 0 to 0 dl 1789760767 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760756.070118:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df258e2df80 with x1876699863152128 ext(3145728->4194303) 00010000:00010000:2.0:1789760756.070131:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005521a6f5/0x3e099f5ef04aea66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 7 type: EXT [3145728->6291455] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d275 expref: 40 pid: 8482 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.070150:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005521a6f5/0x3e099f5ef04aea66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 7 type: EXT [3145728->6291455] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d275 expref: 40 pid: 8482 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760756.070159:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8df258e2df80 00000100:00100000:3.0:1789760756.078606:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760756.079468:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+37:2348:x1876699863152256:12345-192.168.203.12@tcp:4:dd.0 Request processed in 33400us (33562us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1789760756.079483:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 21 00002000:00100000:0.0:1789760756.079497:0:11799:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x6:0x0] (6291456->7340031) req@ffff8df258e2f480 x1876699863152256/t4294967436(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:47/0 lens 488/448 e 0 to 0 dl 1789760767 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760756.079508:0:11799:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df258e2f480 with x1876699863152256 ext(6291456->7340031) 00002000:00010000:0.0:1789760756.079516:0:11799:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df258e2f480 00000100:00100000:2.0:1789760756.082253:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863152640 00000100:00100000:2.0:1789760756.082278:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863152640 00010000:00010000:2.0:1789760756.082319:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005521a6f5/0x3e099f5ef04aea66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 7 type: EXT [3145728->6291455] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d275 expref: 40 pid: 8482 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760756.082366:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:2.0:1789760756.082377:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df260393c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1da0113a-370d-4d79-883c-54efc174697f+40:2351:x1876699863152640:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760756.082393:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760756.082663:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005521a6f5/0x3e099f5ef04aea66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 8 type: EXT [3145728->6291455] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d275 expref: 40 pid: 8482 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.082678:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005521a6f5/0x3e099f5ef04aea66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 8 type: EXT [3145728->6291455] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d275 expref: 40 pid: 8482 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.082700:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005521a6f5/0x3e099f5ef04aea66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 8 type: EXT [3145728->6291455] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d275 expref: 40 pid: 8482 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.082717:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1789760756.082721:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1789760756.082730:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000046a49a68/0x3e099f5ef04aeab3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 7 type: EXT [4194304->7340031] (req 4194304->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2c2 expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.082741:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046a49a68/0x3e099f5ef04aeab3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 7 type: EXT [4194304->7340031] (req 4194304->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2c2 expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.082781:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000046a49a68/0x3e099f5ef04aeab3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 7 type: EXT [4194304->7340031] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2c2 expref: 39 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760756.082886:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2462f8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5831:1876699883056000:192.168.203.12@tcp:105: 00000100:00100000:2.0:1789760756.082969:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259abf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789760756.089049:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14347f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+37:2349:x1876699863152384:12345-192.168.203.12@tcp:4:dd.0 Request processed in 40999us (41314us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1789760756.089065:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 22 00002000:00100000:0.0:1789760756.089080:0:11796:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (7340032->8388607) req@ffff8df14347f480 x1876699863152384/t4294967437(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:47/0 lens 488/448 e 0 to 0 dl 1789760767 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760756.089092:0:11796:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df14347f480 with x1876699863152384 ext(7340032->8388607) 00002000:00010000:0.0:1789760756.089098:0:11796:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df14347f480 00000100:00100000:3.0:1789760756.090428:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760756.090657:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863152768 00000100:00100000:0.0:1789760756.090667:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863152768 00002000:00100000:0.0:1789760756.090711:0:11797:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (7340032->8388607) req@ffff8df25847c000 x1876699863152768/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:47/0 lens 488/0 e 0 to 0 dl 1789760767 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760756.090722:0:11797:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df25847c000 with x1876699863152768 ext(7340032->8388607) 00002000:00010000:0.0:1789760756.090726:0:11797:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df25847c000 00000100:00100000:0.0:1789760756.090743:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 2 deadline 360169394004 time 360169294004 state 0x1 ref 2 00000100:00100000:0.0:1789760756.090782:0:11797:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 2 deadline 360169394004 time 360203976213 state 0x0 ref 2 00000100:00100000:0.0:1789760756.090794:0:11797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25847c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+40:2348:x1876699863152768:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:3.0:1789760756.091115:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 360404307588 time 360204307588 state 0x1 ref 8 00000100:00100000:3.0:1789760756.091129:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+36:2351:x1876699863147392:12345-192.168.203.12@tcp:4:dd.500 00000100:00100000:0.0:1789760756.108306:0:11800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+38:2348:x1876699863152512:12345-192.168.203.12@tcp:4:dd.0 Request processed in 52186us (52984us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1789760756.108320:0:11800:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 23 00002000:00100000:0.0:1789760756.108333:0:11800:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x6:0x0] (4194304->5242879) req@ffff8df27cc45180 x1876699863152512/t4294967438(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:47/0 lens 488/448 e 0 to 0 dl 1789760767 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760756.108342:0:11800:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cc45180 with x1876699863152512 ext(4194304->5242879) 00002000:00010000:0.0:1789760756.108348:0:11800:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df27cc45180 00000100:00100000:3.0:1789760756.116445:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760756.116643:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760756.116736:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863152896 00000100:00100000:0.0:1789760756.116746:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863152896 00002000:00100000:0.0:1789760756.116793:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (3145728->4194303) req@ffff8df25847df80 x1876699863152896/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:47/0 lens 488/0 e 0 to 0 dl 1789760767 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760756.116825:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df25847df80 with x1876699863152896 ext(3145728->4194303) 00002000:00010000:0.0:1789760756.116831:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df25847df80 00000100:00100000:1.0:1789760756.116859:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2462f8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5831:1876699883056000:192.168.203.12@tcp:105: 00000100:00100000:0.0:1789760756.116875:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 2 deadline 360204076213 time 360203976213 state 0x1 ref 2 00010000:00010000:1.0:1789760756.116884:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760756.116899:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863153024 00000100:00100000:0.0:1789760756.116904:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863153024 00002000:00100000:0.0:1789760756.116924:0:11799:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x6:0x0] (5242880->6291455) req@ffff8df14347ce00 x1876699863153024/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:47/0 lens 488/0 e 0 to 0 dl 1789760767 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1789760756.116932:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df260393c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1da0113a-370d-4d79-883c-54efc174697f+41:2351:x1876699863152640:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 34555us (38344us total) trans 0 rc 0/0 00002000:00100000:0.0:1789760756.116934:0:11799:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df14347ce00 with x1876699863153024 ext(5242880->6291455) 00002000:00010000:0.0:1789760756.116941:0:11799:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df14347ce00 00000100:00100000:1.0:1789760756.116947:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:0.0:1789760756.116960:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 2 deadline 360204076213 time 360203976213 state 0x1 ref 3 00000100:00100000:0.0:1789760756.116995:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 2 deadline 360230289567 time 360230189567 state 0x1 ref 3 00000100:00100000:0.0:1789760756.117009:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25847df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+39:2350:x1876699863152896:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:0.0:1789760756.117154:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 2 deadline 360230289567 time 360230348782 state 0x0 ref 3 00000100:00100000:0.0:1789760756.117165:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14347ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+40:2350:x1876699863153024:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:0.0:1789760756.128503:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760756.128543:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760756.128564:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760756.128600:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760756.128690:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863153408 00000100:00100000:2.0:1789760756.128700:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863153408 00002000:00100000:2.0:1789760756.128749:0:11798:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x6:0x0] (4194304->5242879) req@ffff8df14347c000 x1876699863153408/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:47/0 lens 488/0 e 0 to 0 dl 1789760767 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760756.128760:0:11798:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df14347c000 with x1876699863153408 ext(4194304->5242879) 00002000:00010000:2.0:1789760756.128765:0:11798:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df14347c000 00000100:00100000:3.0:1789760756.128798:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863153664 00000100:00100000:2.0:1789760756.128822:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 2 deadline 360230448782 time 360230348782 state 0x1 ref 4 00000100:00100000:3.0:1789760756.128830:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863153664 00000100:00100000:3.0:1789760756.128874:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:3.0:1789760756.128884:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+13:11066:x1876699863153664:12345-192.168.203.12@tcp:35:dd.0 00000100:00100000:2.0:1789760756.128938:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863153280 00000100:00100000:2.0:1789760756.128944:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863153280 00000100:00100000:0.0:1789760756.128954:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863153152 00000100:00100000:0.0:1789760756.128960:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863153152 00002000:00100000:2.0:1789760756.128970:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->1048575) req@ffff8df2747f8e00 x1876699863153280/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:47/0 lens 488/0 e 0 to 0 dl 1789760767 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760756.128987:0:11800:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x6:0x0] (2097152->3145727) req@ffff8df2517f7800 x1876699863153152/t0(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:47/0 lens 488/0 e 0 to 0 dl 1789760767 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760756.128997:0:11800:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df2517f7800 with x1876699863153152 ext(2097152->3145727) 00002000:00010000:0.0:1789760756.129001:0:11800:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df2517f7800 00000100:00100000:0.0:1789760756.129009:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 2 deadline 360230448782 time 360230348782 state 0x1 ref 5 00000100:00100000:0.0:1789760756.129023:0:11800:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 2 deadline 360242318425 time 360242218425 state 0x1 ref 5 00000100:00100000:0.0:1789760756.129034:0:11800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14347c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+41:2348:x1876699863153408:12345-192.168.203.12@tcp:4:dd.0 00002000:00100000:2.0:1789760756.129056:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df2747f8e00 with x1876699863153280 ext(0->1048575) 00002000:00010000:2.0:1789760756.129060:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df2747f8e00 00000100:00100000:2.0:1789760756.129068:0:6699:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 2 deadline 360242318425 time 360242218425 state 0x1 ref 6 00000100:00100000:2.0:1789760756.129081:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 1 deadline 360242376835 time 360242276835 state 0x1 ref 6 00000100:00100000:2.0:1789760756.129093:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2517f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+43:2350:x1876699863153152:12345-192.168.203.12@tcp:4:dd.0 00000100:00100000:0.0:1789760756.129186:0:6698:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 1 deadline 360242376835 time 360242380402 state 0x0 ref 6 00000100:00100000:0.0:1789760756.129199:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+44:2350:x1876699863153280:12345-192.168.203.12@tcp:4:dd.0 00000001:00080000:3.0:1789760756.130138:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1789760756.130279:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+15:11066:x1876699863153664:12345-192.168.203.12@tcp:35:dd.0 Request processed in 1394us (1732us total) trans 4294967385 rc 0/0 00000100:00100000:3.0:1789760756.130290:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 31 00000020:00080000:3.0:1789760756.130309:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789760756.141238:0:11797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25847c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+43:2348:x1876699863152768:12345-192.168.203.12@tcp:4:dd.0 Request processed in 50427us (50799us total) trans 4294967339 rc 0/0 00000100:00100000:0.0:1789760756.141250:0:11797:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 24 00002000:00100000:0.0:1789760756.141263:0:11797:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6:0x0] (7340032->8388607) req@ffff8df25847c000 x1876699863152768/t4294967339(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:47/0 lens 488/448 e 0 to 0 dl 1789760767 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760756.141273:0:11797:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df25847c000 with x1876699863152768 ext(7340032->8388607) 00002000:00010000:0.0:1789760756.141279:0:11797:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df25847c000 00000100:00100000:3.0:1789760756.149545:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+46:2351:x1876699863147392:12345-192.168.203.12@tcp:4:dd.500 Request processed in 58408us (757258us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1789760756.149561:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 10 00002000:00100000:3.0:1789760756.149575:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (4194304->5242879) req@ffff8df27cb21500 x1876699863147392/t4294967439(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:46/0 lens 488/448 e 0 to 0 dl 1789760766 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789760756.149583:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cb21500 with x1876699863147392 ext(4194304->5242879) 00002000:00010000:3.0:1789760756.149589:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df27cb21500 00000100:00100000:0.0:1789760756.154515:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25847df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+46:2350:x1876699863152896:12345-192.168.203.12@tcp:4:dd.0 Request processed in 37500us (38077us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1789760756.154529:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 25 00002000:00100000:0.0:1789760756.154541:0:11799:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x6:0x0] (3145728->4194303) req@ffff8df25847df80 x1876699863152896/t4294967440(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:47/0 lens 488/448 e 0 to 0 dl 1789760767 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760756.154551:0:11799:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df25847df80 with x1876699863152896 ext(3145728->4194303) 00002000:00010000:0.0:1789760756.154557:0:11799:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df25847df80 00000100:00100000:1.0:1789760756.160956:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14347ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+46:2350:x1876699863153024:12345-192.168.203.12@tcp:4:dd.0 Request processed in 43782us (44304us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1789760756.160971:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 26 00002000:00100000:1.0:1789760756.160985:0:11796:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (5242880->6291455) req@ffff8df14347ce00 x1876699863153024/t4294967441(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:47/0 lens 488/448 e 0 to 0 dl 1789760767 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789760756.161013:0:11796:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df14347ce00 with x1876699863153024 ext(5242880->6291455) 00002000:00010000:1.0:1789760756.161020:0:11796:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df14347ce00 00000100:00100000:0.0:1789760756.164197:0:11800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14347c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+43:2348:x1876699863153408:12345-192.168.203.12@tcp:4:dd.0 Request processed in 35108us (35646us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1789760756.164210:0:11800:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 27 00002000:00100000:0.0:1789760756.164237:0:11800:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x6:0x0] (4194304->5242879) req@ffff8df14347c000 x1876699863153408/t4294967340(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:47/0 lens 488/448 e 0 to 0 dl 1789760767 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789760756.164249:0:11800:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df14347c000 with x1876699863153408 ext(4194304->5242879) 00002000:00010000:0.0:1789760756.164256:0:11800:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df14347c000 00000100:00100000:2.0:1789760756.172030:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2517f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+46:2350:x1876699863153152:12345-192.168.203.12@tcp:4:dd.0 Request processed in 42930us (43418us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1789760756.172045:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 28 00002000:00100000:2.0:1789760756.172069:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (2097152->3145727) req@ffff8df2517f7800 x1876699863153152/t4294967442(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:47/0 lens 488/448 e 0 to 0 dl 1789760767 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760756.172080:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df2517f7800 with x1876699863153152 ext(2097152->3145727) 00002000:00010000:2.0:1789760756.172085:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df2517f7800 00000100:00100000:2.0:1789760756.177841:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1da0113a-370d-4d79-883c-54efc174697f+46:2350:x1876699863153280:12345-192.168.203.12@tcp:4:dd.0 Request processed in 48633us (49263us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1789760756.177857:0:6698:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:2.0:1789760756.177865:0:6698:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 1 deadline 360242376835 time 360242380402 state 0x2 ref 0 00002000:00100000:2.0:1789760756.177882:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->1048575) req@ffff8df2747f8e00 x1876699863153280/t4294967443(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:47/0 lens 488/448 e 0 to 0 dl 1789760767 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760756.177893:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df2747f8e00 with x1876699863153280 ext(0->1048575) 00002000:00010000:2.0:1789760756.177900:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df2747f8e00 00000100:00100000:2.0:1789760756.291292:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 360604477022 time 360404477022 state 0x1 ref 7 00000100:00100000:2.0:1789760756.291326:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+45:2350:x1876699863147520:12345-192.168.203.12@tcp:4:dd.500 00000100:00100000:2.0:1789760756.307159:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+47:2350:x1876699863147520:12345-192.168.203.12@tcp:4:dd.500 Request processed in 15840us (897618us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1789760756.307172:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 11 00002000:00100000:2.0:1789760756.307185:0:11798:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x5:0x0] (5242880->6291455) req@ffff8df27cb23800 x1876699863147520/t4294967444(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:46/0 lens 488/448 e 0 to 0 dl 1789760766 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760756.307196:0:11798:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cb23800 with x1876699863147520 ext(5242880->6291455) 00002000:00010000:2.0:1789760756.307201:0:11798:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df27cb23800 00000100:00100000:3.0:1789760756.491476:0:11801:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 360804657980 time 360604657980 state 0x1 ref 6 00000100:00100000:3.0:1789760756.491512:0:11801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27218a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+46:2350:x1876699863147648:12345-192.168.203.12@tcp:4:dd.500 00000100:00100000:2.0:1789760756.509609:0:11801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27218a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1da0113a-370d-4d79-883c-54efc174697f+48:2350:x1876699863147648:12345-192.168.203.12@tcp:4:dd.500 Request processed in 18103us (1077636us total) trans 4294967445 rc 0/0 00000100:00100000:2.0:1789760756.509634:0:11801:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 12 00002000:00100000:2.0:1789760756.509658:0:11801:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x5:0x0] (6291456->7340031) req@ffff8df27218a300 x1876699863147648/t4294967445(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:46/0 lens 488/448 e 0 to 0 dl 1789760766 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789760756.509667:0:11801:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27218a300 with x1876699863147648 ext(6291456->7340031) 00002000:00010000:2.0:1789760756.509674:0:11801:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df27218a300 00000100:00100000:0.0:1789760756.692136:0:11797:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 361005322322 time 360805322322 state 0x1 ref 5 00000100:00100000:0.0:1789760756.692166:0:11797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+47:2350:x1876699863147776:12345-192.168.203.12@tcp:4:dd.500 00000100:00100000:3.0:1789760756.707451:0:11797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+49:2350:x1876699863147776:12345-192.168.203.12@tcp:4:dd.500 Request processed in 15275us (1243548us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1789760756.707477:0:11797:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 13 00002000:00100000:3.0:1789760756.707490:0:11797:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x5:0x0] (7340032->8388607) req@ffff8df27cb21f80 x1876699863147776/t4294967446(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:46/0 lens 488/448 e 0 to 0 dl 1789760766 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789760756.707501:0:11797:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cb21f80 with x1876699863147776 ext(7340032->8388607) 00002000:00010000:3.0:1789760756.707508:0:11797:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df27cb21f80 00000100:00100000:1.0:1789760756.815158:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2517f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883056256:0@lo:400:kworker.0 00000100:00100000:0.0:1789760756.815169:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2517f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883056512:0@lo:400:kworker.0 00000100:00100000:2.0:1789760756.815208:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2517f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883056128:0@lo:400:kworker.0 00000100:00100000:3.0:1789760756.815233:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2517f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883056384:0@lo:400:kworker.0 00000100:00100000:1.0:1789760756.815245:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760756.816369:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760756.816475:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760756.816510:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2517f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1876699883056640:0@lo:400:kworker.0 00000100:00100000:3.0:1789760756.816591:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883056128 00000100:00100000:3.0:1789760756.816598:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883056128 00000100:00100000:3.0:1789760756.816645:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1789760756.816661:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247885850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883056128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760756.820492:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d32b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883056768:0@lo:400:kworker.0 00000100:00100000:1.0:1789760756.820573:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760756.820780:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883056256 00000100:00100000:1.0:1789760756.820789:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883056256 00000100:00100000:1.0:1789760756.820850:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883056384 00000100:00100000:1.0:1789760756.820854:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883056384 00000100:00100000:1.0:1789760756.820889:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789760756.820898:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883056256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760756.820953:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883056256:12345-0@lo:400:kworker.0 Request processed in 57us (5709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760756.820960:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789760756.821044:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789760756.821051:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883056384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760756.821090:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883056384:12345-0@lo:400:kworker.0 Request processed in 40us (4724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760756.821097:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:1.0:1789760756.821116:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760756.821147:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2517f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883056384:0@lo:400:kworker.0 00000100:00100000:1.0:1789760756.821180:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2517f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883056256:0@lo:400:kworker.0 00000100:00100000:1.0:1789760756.821483:0:12459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883056768 00000100:00100000:1.0:1789760756.821500:0:12459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883056768 00000100:00080000:1.0:1789760756.821517:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789760756.821547:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789760756.821555:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883056768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760756.821727:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883056768:12345-0@lo:400:kworker.0 Request processed in 172us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760756.821734:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789760756.821764:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d32b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883056768:0@lo:400:kworker.0 00000100:00100000:2.0:1789760756.821939:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760756.821942:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760756.821990:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883056512 00000100:00100000:2.0:1789760756.821995:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883056512 00000100:00100000:2.0:1789760756.822027:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789760756.822035:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d32b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883056512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760756.822062:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883056640 00000100:00100000:1.0:1789760756.822067:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883056640 00000100:00100000:2.0:1789760756.822076:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d32b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883056512:12345-0@lo:400:kworker.0 Request processed in 41us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760756.822084:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789760756.822104:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789760756.822111:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2462faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876699883056640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760756.822151:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2462faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876699883056640:12345-0@lo:400:kworker.0 Request processed in 40us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760756.822157:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:1.0:1789760756.822172:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760756.822235:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2517f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1876699883056640:0@lo:400:kworker.0 00000100:00100000:0.0:1789760756.822249:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2517f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883056512:0@lo:400:kworker.0 00000100:00100000:3.0:1789760756.822482:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247885850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883056128:12345-0@lo:400:kworker.0 Request processed in 5821us (6005us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760756.822492:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789760756.822518:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2517f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883056128:0@lo:400:kworker.0 00000100:00100000:3.0:1789760756.892457:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 361205640543 time 361005640543 state 0x1 ref 4 00000100:00100000:3.0:1789760756.892493:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+42:2350:x1876699863147904:12345-192.168.203.12@tcp:4:dd.500 00000100:00100000:3.0:1789760756.909272:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+44:2350:x1876699863147904:12345-192.168.203.12@tcp:4:dd.500 Request processed in 16787us (1393224us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1789760756.909287:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 14 00002000:00100000:3.0:1789760756.909303:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (4194304->5242879) req@ffff8df258e39f80 x1876699863147904/t4294967341(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:46/0 lens 488/448 e 0 to 0 dl 1789760766 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789760756.909314:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df258e39f80 with x1876699863147904 ext(4194304->5242879) 00002000:00010000:3.0:1789760756.909334:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df258e39f80 00010000:00010000:2.0:1789760756.943661:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760757.092692:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 361405877289 time 361205877289 state 0x1 ref 3 00000100:00100000:0.0:1789760757.092727:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+43:2349:x1876699863148032:12345-192.168.203.12@tcp:4:dd.500 00000100:00100000:0.0:1789760757.101241:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+45:2349:x1876699863148032:12345-192.168.203.12@tcp:4:dd.500 Request processed in 8520us (1556906us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1789760757.101256:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 15 00002000:00100000:0.0:1789760757.101269:0:11799:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x5:0x0] (5242880->6291455) req@ffff8df27cb20000 x1876699863148032/t4294967342(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:46/0 lens 488/448 e 0 to 0 dl 1789760766 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789760757.102154:0:11799:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df27cb20000 with x1876699863148032 ext(5242880->6291455) 00002000:00010000:0.0:1789760757.102161:0:11799:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df27cb20000 00000100:00100000:1.0:1789760757.297666:0:11796:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 361610843336 time 361410843336 state 0x1 ref 2 00000100:00100000:1.0:1789760757.297701:0:11796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df272189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+44:2348:x1876699863148160:12345-192.168.203.12@tcp:4:dd.500 00000100:00100000:1.0:1789760757.321076:0:11796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df272189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1da0113a-370d-4d79-883c-54efc174697f+46:2348:x1876699863148160:12345-192.168.203.12@tcp:4:dd.500 Request processed in 23381us (1597660us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1789760757.321089:0:11796:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 16 00002000:00100000:1.0:1789760757.321102:0:11796:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x5:0x0] (6291456->7340031) req@ffff8df272189880 x1876699863148160/t4294967343(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:46/0 lens 488/448 e 0 to 0 dl 1789760766 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789760757.321113:0:11796:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df272189880 with x1876699863148160 ext(6291456->7340031) 00002000:00010000:1.0:1789760757.321120:0:11796:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df272189880 00000100:00100000:2.0:1789760757.327183:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789760757.327219:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df244d0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883056896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760757.327286:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760757.327533:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883056896 00000100:00100000:3.0:1789760757.327541:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883056896 00000100:00100000:3.0:1789760757.327608:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789760757.327622:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2462fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883056896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789760757.327757:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5111808 granted 95354880 pending 25559040 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760757.327888:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2462fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883056896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 271us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760757.327896:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789760757.328042:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df244d0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883056896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760757.497848:0:11800:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 361610843336 time 361611031901 state 0x0 ref 1 00000100:00100000:0.0:1789760757.497891:0:11800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+45:2348:x1876699863148544:12345-192.168.203.12@tcp:4:dd.500 00000100:00100000:3.0:1789760757.529995:0:11800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1da0113a-370d-4d79-883c-54efc174697f+47:2348:x1876699863148544:12345-192.168.203.12@tcp:4:dd.500 Request processed in 32110us (1773127us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1789760757.530009:0:11800:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:3.0:1789760757.530017:0:11800:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 361610843336 time 361611031901 state 0x2 ref 0 00002000:00100000:3.0:1789760757.530034:0:11800:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x5:0x0] (7340032->8388607) req@ffff8df2747bb800 x1876699863148544/t4294967344(0) o4->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:46/0 lens 488/448 e 0 to 0 dl 1789760766 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789760757.530043:0:11800:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df2747bb800 with x1876699863148544 ext(7340032->8388607) 00002000:00010000:3.0:1789760757.530049:0:11800:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8df2747bb800 00000100:00100000:2.0:1789760757.593161:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760757.593308:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863153792 00000100:00100000:0.0:1789760757.593318:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863153792 00000100:00100000:0.0:1789760757.593388:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:0.0:1789760757.593400:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2462f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1da0113a-370d-4d79-883c-54efc174697f+49:5585:x1876699863153792:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789760757.593414:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 8 locks, starting at 0 00002000:00010000:0.0:1789760757.593434:0:5829:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:0.0:1789760757.593437:0:5829:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789760753 -> 1789760754 00002000:00010000:0.0:1789760757.593451:0:5829:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789760753 -> 1789760754 00010000:00010000:0.0:1789760757.593474:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b81484bf/0x3e099f5ef04aea27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d252 expref: 49 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760757.593508:0:5829:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 2097152 -> 8388608 00010000:00010000:0.0:1789760757.593518:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aea5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 9 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d26e expref: 48 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.593530:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfd0c19c/0x3e099f5ef04aea90 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d29f expref: 47 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.593542:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d571eff3/0x3e099f5ef04aeaa5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 7 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44801000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2b4 expref: 46 pid: 12460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.593555:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000996d94d0/0x3e099f5ef04aea9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2ad expref: 45 pid: 12460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.593566:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbb9ed98/0x3e099f5ef04aea89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44801000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d298 expref: 44 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.593578:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aeaba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x44801000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2c9 expref: 43 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.593590:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029ef3a94/0x3e099f5ef04aeaac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44801000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2bb expref: 42 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.593614:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760757.593672:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2462f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1da0113a-370d-4d79-883c-54efc174697f+41:5585:x1876699863153792:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 274us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760757.593680:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:0.0:1789760757.607038:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760757.607220:0:7645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863153920 00000100:00100000:3.0:1789760757.607229:0:7645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863153920 00000100:00100000:3.0:1789760757.607295:0:7645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:3.0:1789760757.607307:0:7645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df244d0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1da0113a-370d-4d79-883c-54efc174697f+47:9586:x1876699863153920:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789760757.607321:0:7645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 6 locks, starting at 0 00002000:00010000:3.0:1789760757.607341:0:7645:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:3.0:1789760757.607344:0:7645:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789760753 -> 1789760755 00002000:00010000:3.0:1789760757.607346:0:7645:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789760753 -> 1789760755 00010000:00010000:3.0:1789760757.607383:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e85c43d2/0x3e099f5ef04aea2e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d259 expref: 47 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760757.607415:0:7645:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 7340032 -> 8388608 00010000:00010000:3.0:1789760757.607424:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046a49a68/0x3e099f5ef04aeab3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 7 type: EXT [4194304->7340031] (req 4194304->5242879) gid 0 flags: 0x44801000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2c2 expref: 46 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.607437:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c3aa1b0/0x3e099f5ef04aea97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 6 type: EXT [7340032->18446744073709551615] (req 7340032->8388607) gid 0 flags: 0x44801000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2a6 expref: 45 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.607448:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025a794a9/0x3e099f5ef04aea7b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d28a expref: 44 pid: 8482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.607458:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea5f19f5/0x3e099f5ef04aea58 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d267 expref: 43 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.607469:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb9133a7/0x3e099f5ef04aea74 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801000020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d27c expref: 42 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.607481:0:7645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760757.607643:0:7645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df244d0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1da0113a-370d-4d79-883c-54efc174697f+41:9586:x1876699863153920:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 339us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760757.607651:0:7645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:1.0:1789760757.697435:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760757.697566:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863154176 00000100:00100000:2.0:1789760757.697575:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863154176 00000100:00100000:2.0:1789760757.697648:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:2.0:1789760757.697658:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2517f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+15:11093:x1876699863154176:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1789760757.697681:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760757.697699:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2c00/0x3e099f5ef04aeac1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d2d0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.697774:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04aeac8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.697788:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04aeac8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.697831:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04aeac8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.697844:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3e00/0x3e099f5ef04aeacf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.697851:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3e00/0x3e099f5ef04aeacf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.697858:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3e00/0x3e099f5ef04aeacf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.698389:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3c00/0x3e099f5ef04aead6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.698399:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3c00/0x3e099f5ef04aead6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.698412:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3c00/0x3e099f5ef04aead6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760757.698483:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xf:0x0]: returning size 16777216 00010000:00010000:2.0:1789760757.698570:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04aeac8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.698578:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04aeac8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.698584:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04aeac8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.698590:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3600 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760757.698594:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04aeac8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.698602:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04aeac8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.698613:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df2502f3500) 00010000:00010000:2.0:1789760757.698616:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760757.698620:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04aeac8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.698626:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04aeac8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.698691:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3e00/0x3e099f5ef04aeacf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.698698:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3e00/0x3e099f5ef04aeacf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.698710:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3e00/0x3e099f5ef04aeacf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.698715:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3e00 already unused, calling callback (ffffffffc200b4f0) 00000100:00080000:1.0:1789760757.698832:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789760757.699863:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3e00/0x3e099f5ef04aeacf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.699879:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3e00/0x3e099f5ef04aeacf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.699893:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0xe7cddcd6 (ffff8df250325b00) 00010000:00010000:2.0:1789760757.699895:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760757.699900:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3e00/0x3e099f5ef04aeacf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.699905:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3e00/0x3e099f5ef04aeacf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.700097:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2c00/0x3e099f5ef04aeac1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2d0 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.700114:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3c00/0x3e099f5ef04aead6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2d0 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.700122:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff8df245dcc800) 00010000:00010000:2.0:1789760757.700124:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789760757.700127:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2517f3c00, rc 0) 00000100:00100000:2.0:1789760757.700246:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2517f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+17:11093:x1876699863154176:12345-192.168.203.12@tcp:101:dd.0 Request processed in 2588us (2829us total) trans 4294967386 rc 0/0 00000100:00100000:2.0:1789760757.700269:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:2.0:1789760757.714710:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760757.714781:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760757.714855:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760757.714934:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863154560 00000100:00100000:1.0:1789760757.714943:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863154560 00000100:00100000:1.0:1789760757.715003:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863154944 00000100:00100000:1.0:1789760757.715007:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863154944 00000100:00100000:1.0:1789760757.715030:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 89 00000100:00100000:1.0:1789760757.715038:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2462f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+42:11108:x1876699863154560:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:1.0:1789760757.715057:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760757.715077:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea5f19f5/0x3e099f5ef04aeae4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d2e5 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760757.715104:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 8388608, mtime: 0x6aad94f2, atime: 0x6aad94f1, ctime: 0x6aad94f2, blocks: 0x1 00010000:00010000:1.0:1789760757.715124:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=361s v=(0 0) 00010000:00010000:1.0:1789760757.715129:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760757.715139:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea5f19f5/0x3e099f5ef04aeae4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2e5 expref: 43 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760757.715156:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ea5f19f5/0x3e099f5ef04aeae4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2e5 expref: 43 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760757.715169:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df25861f200, rc 0) 00000100:00100000:1.0:1789760757.715245:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2462f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+43:11108:x1876699863154560:12345-192.168.203.12@tcp:101:dd.0 Request processed in 207us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760757.715252:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 89 00000100:00100000:1.0:1789760757.715269:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 90 00000100:00100000:1.0:1789760757.715275:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ac29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+42:11105:x1876699863154944:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:1.0:1789760757.715289:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760757.715297:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aeaeb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d2f3 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760757.715309:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760757.715313:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760757.715319:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aeaeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2f3 expref: 43 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760757.715330:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aeaeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2f3 expref: 43 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760757.715339:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df25861ea00, rc 0) 00000100:00100000:1.0:1789760757.715359:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ac29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+43:11105:x1876699863154944:12345-192.168.203.12@tcp:101:dd.0 Request processed in 84us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760757.715365:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 90 00000100:00100000:3.0:1789760757.715903:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863154816 00000100:00100000:3.0:1789760757.715909:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863154816 00000100:00100000:3.0:1789760757.715951:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:3.0:1789760757.715958:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ac2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+17:11099:x1876699863154816:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1789760757.715991:0:7279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760757.716004:0:7279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe000/0x3e099f5ef04aeaf2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d2d7 expref: -99 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.716068:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe600/0x3e099f5ef04aeaf9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.716081:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe600/0x3e099f5ef04aeaf9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.716091:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe600/0x3e099f5ef04aeaf9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.716103:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbea00/0x3e099f5ef04aeb00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.716109:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbea00/0x3e099f5ef04aeb00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.716115:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbea00/0x3e099f5ef04aeb00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.716444:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe200/0x3e099f5ef04aeb07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.716455:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe200/0x3e099f5ef04aeb07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.716464:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe200/0x3e099f5ef04aeb07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760757.716474:0:7279:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xf:0x0]: returning size 16777216 00010000:00010000:3.0:1789760757.716575:0:7279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe600/0x3e099f5ef04aeaf9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.716583:0:7279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe600/0x3e099f5ef04aeaf9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.716590:0:7279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe600/0x3e099f5ef04aeaf9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.716597:0:7279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df277dbe600 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760757.716601:0:7279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe600/0x3e099f5ef04aeaf9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.716608:0:7279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe600/0x3e099f5ef04aeaf9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.716621:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df2502f3500) 00010000:00010000:3.0:1789760757.716624:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760757.716628:0:7279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe600/0x3e099f5ef04aeaf9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.716635:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe600/0x3e099f5ef04aeaf9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.716648:0:7279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbea00/0x3e099f5ef04aeb00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.716654:0:7279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbea00/0x3e099f5ef04aeb00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.717728:0:7279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbea00/0x3e099f5ef04aeb00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.717749:0:7279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df277dbea00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760757.717754:0:7279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbea00/0x3e099f5ef04aeb00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.717762:0:7279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbea00/0x3e099f5ef04aeb00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.717773:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0xe7cddcd6 (ffff8df245dccc00) 00010000:00010000:3.0:1789760757.717776:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760757.717780:0:7279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbea00/0x3e099f5ef04aeb00 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.717787:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbea00/0x3e099f5ef04aeb00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.717869:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe000/0x3e099f5ef04aeaf2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2d7 expref: 20 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.717883:0:7279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe200/0x3e099f5ef04aeb07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2d7 expref: 19 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.717891:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff8df245dcc800) 00010000:00010000:3.0:1789760757.717893:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789760757.717895:0:7279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df277dbe200, rc 0) 00000100:00100000:3.0:1789760757.717972:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ac2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+19:11099:x1876699863154816:12345-192.168.203.12@tcp:101:dd.0 Request processed in 2005us (3107us total) trans 4294967387 rc 0/0 00000100:00100000:3.0:1789760757.717980:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:0.0:1789760757.718952:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760757.720838:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863154688 00000100:00100000:2.0:1789760757.720852:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863154688 00000100:00100000:2.0:1789760757.720908:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 91 00000100:00100000:2.0:1789760757.720918:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df244d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+43:11093:x1876699863154688:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1789760757.720937:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760757.721034:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099791bdf/0x3e099f5ef04aeb15 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d2ec expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.721066:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760757.721071:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760757.721080:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099791bdf/0x3e099f5ef04aeb15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2ec expref: 44 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.721097:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000099791bdf/0x3e099f5ef04aeb15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2ec expref: 44 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.721109:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2517f2c00, rc 0) 00000100:00100000:2.0:1789760757.726214:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df244d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+44:11093:x1876699863154688:12345-192.168.203.12@tcp:101:dd.0 Request processed in 5276us (7245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760757.726228:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 91 00000100:00100000:0.0:1789760757.727483:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760757.727677:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760757.731091:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760757.731857:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863154432 00000100:00100000:2.0:1789760757.731868:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863154432 00000100:00100000:3.0:1789760757.732003:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863155072 00000100:00100000:3.0:1789760757.732014:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863155072 00000100:00100000:3.0:1789760757.732047:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:3.0:1789760757.732057:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df244d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+45:11103:x1876699863154432:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1789760757.732075:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760757.732092:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043f45fa3/0x3e099f5ef04aeb1c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d2de expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.732117:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760757.732122:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760757.732130:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043f45fa3/0x3e099f5ef04aeb1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2de expref: 46 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.732146:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043f45fa3/0x3e099f5ef04aeb1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2de expref: 46 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.732158:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df277dbf000, rc 0) 00000100:00100000:3.0:1789760757.732238:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df244d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+46:11103:x1876699863154432:12345-192.168.203.12@tcp:101:dd.0 Request processed in 181us (4759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760757.732245:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:3.0:1789760757.732264:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:3.0:1789760757.732271:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df244d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+45:11096:x1876699863155072:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1789760757.732278:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760757.732285:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018197af4/0x3e099f5ef04aeb23 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d2fa expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.732297:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760757.732307:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760757.732312:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018197af4/0x3e099f5ef04aeb23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2fa expref: 46 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.732324:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000018197af4/0x3e099f5ef04aeb23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2fa expref: 46 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.732333:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df277dbf600, rc 0) 00000100:00100000:3.0:1789760757.732351:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df244d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+46:11096:x1876699863155072:12345-192.168.203.12@tcp:101:dd.0 Request processed in 82us (4676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760757.732357:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:0.0:1789760757.732795:0:12460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863155200 00000100:00100000:0.0:1789760757.732820:0:12460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863155200 00000100:00100000:0.0:1789760757.732857:0:12460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:0.0:1789760757.732865:0:12460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df244d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1da0113a-370d-4d79-883c-54efc174697f+46:11097:x1876699863155200:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:0.0:1789760757.732872:0:12460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760757.732881:0:12460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aeb2a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d301 expref: -99 pid: 12460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.732895:0:12460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760757.732898:0:12460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760757.732905:0:12460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aeb2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d301 expref: 47 pid: 12460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.732916:0:12460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aeb2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d301 expref: 47 pid: 12460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.732938:0:12460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df24627c400, rc 0) 00000100:00100000:0.0:1789760757.732969:0:12460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df244d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1da0113a-370d-4d79-883c-54efc174697f+47:11097:x1876699863155200:12345-192.168.203.12@tcp:101:dd.0 Request processed in 105us (1887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760757.732975:0:12460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:0.0:1789760757.733023:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760757.733043:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863155328 00000100:00100000:0.0:1789760757.733047:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863155328 00000100:00100000:0.0:1789760757.733073:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:0.0:1789760757.733080:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df244d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1da0113a-370d-4d79-883c-54efc174697f+19:2351:x1876699863155328:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789760757.733090:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760757.733108:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe200/0x3e099f5ef04aeb07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2d7 expref: 19 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.733123:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff8df245dcc800) 00010000:00010000:0.0:1789760757.733127:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760757.733146:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df244d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1da0113a-370d-4d79-883c-54efc174697f+18:2351:x1876699863155328:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 67us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760757.733152:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:0.0:1789760757.733317:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760757.733366:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760757.733450:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863155584 00000100:00100000:2.0:1789760757.733455:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863155584 00000100:00100000:2.0:1789760757.733493:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:2.0:1789760757.733502:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df244d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+18:11099:x1876699863155584:12345-192.168.203.12@tcp:35:dd.0 00000100:00100000:2.0:1789760757.733697:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df244d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+19:11099:x1876699863155584:12345-192.168.203.12@tcp:35:dd.0 Request processed in 196us (380us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1789760757.733705:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:2.0:1789760757.733725:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863155712 00000100:00100000:2.0:1789760757.733729:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863155712 00002000:00100000:2.0:1789760757.733753:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->1048575) req@ffff8df244d0fb80 x1876699863155712/t0(0) o3->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:48/0 lens 488/0 e 0 to 0 dl 1789760768 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760757.733763:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df244d0fb80 with x1876699863155712 ext(0->1048575) 00002000:00010000:2.0:1789760757.733768:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df244d0fb80 00000100:00100000:2.0:1789760757.733779:0:6699:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 1 deadline 360242376835 time 360242380402 state 0x0 ref 1 00000100:00100000:2.0:1789760757.733788:0:6699:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 1 deadline 360242480402 time 360242380402 state 0x1 ref 1 00000100:00100000:2.0:1789760757.733831:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 2 deadline 360242480402 time 361847026052 state 0x0 ref 1 00000100:00100000:2.0:1789760757.733841:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df244d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+47:2349:x1876699863155712:12345-192.168.203.12@tcp:3:dd.0 00000100:00100000:2.0:1789760757.753032:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df244d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+47:2349:x1876699863155712:12345-192.168.203.12@tcp:3:dd.0 Request processed in 19180us (19654us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760757.753045:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:2.0:1789760757.753054:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df261ee8000 key gid={0} rule@0xffff8df274bf2500 gen 0 rate 10000 depth 3 token 2 deadline 360242480402 time 361847026052 state 0x2 ref 0 00002000:00100000:2.0:1789760757.753069:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->1048575) req@ffff8df244d0fb80 x1876699863155712/t0(0) o3->1da0113a-370d-4d79-883c-54efc174697f@192.168.203.12@tcp:48/0 lens 488/440 e 0 to 0 dl 1789760768 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789760757.753099:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df244d0fb80 with x1876699863155712 ext(0->1048575) 00002000:00010000:2.0:1789760757.753105:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df244d0fb80 00000100:00100000:1.0:1789760757.828311:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760757.832139:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863155968 00000100:00100000:2.0:1789760757.832152:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863155968 00000100:00100000:3.0:1789760757.833144:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:3.0:1789760757.833158:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2517f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+19:11099:x1876699863155968:12345-192.168.203.12@tcp:35:dd.0 00000100:00100000:3.0:1789760757.833668:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2517f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+20:11099:x1876699863155968:12345-192.168.203.12@tcp:35:dd.0 Request processed in 512us (5364us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1789760757.833676:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:3.0:1789760757.870631:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760757.870693:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863156096 00000100:00100000:0.0:1789760757.870703:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863156096 00000100:00100000:0.0:1789760757.870754:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:0.0:1789760757.870764:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+20:11111:x1876699863156096:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:0.0:1789760757.870850:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760757.870879:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c600/0x3e099f5ef04aeb31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d308 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.870956:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c800/0x3e099f5ef04aeb38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.870970:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c800/0x3e099f5ef04aeb38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.870981:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c800/0x3e099f5ef04aeb38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760757.871015:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 16384 00000004:00200000:0.0:1789760757.871018:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789760757.871035:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c800/0x3e099f5ef04aeb38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.871061:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c600/0x3e099f5ef04aeb31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d308 expref: 22 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.871077:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c800/0x3e099f5ef04aeb38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d308 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.871086:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df2502f3500) 00010000:00010000:0.0:1789760757.871089:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789760757.871092:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df24627c800, rc 0) 00000100:00100000:0.0:1789760757.871144:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+21:11111:x1876699863156096:12345-192.168.203.12@tcp:101:rm.0 Request processed in 381us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760757.871151:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:1.0:1789760757.876955:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760757.877095:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863156352 00000100:00100000:2.0:1789760757.877105:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863156352 00000100:00100000:2.0:1789760757.877166:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:2.0:1789760757.877176:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2517f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+21:11111:x1876699863156352:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:2.0:1789760757.877194:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760757.877220:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3e00/0x3e099f5ef04aeb3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d30f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760757.877299:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 16384 00010000:00010000:2.0:1789760757.877407:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3e00/0x3e099f5ef04aeb3f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d30f expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.877422:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df245dcc300) 00010000:00010000:2.0:1789760757.877425:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789760757.877429:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3e00/0x3e099f5ef04aeb3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d30f expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.877443:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2517f3e00, rc 0) 00000100:00100000:2.0:1789760757.878127:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2517f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+22:11111:x1876699863156352:12345-192.168.203.12@tcp:101:rm.0 Request processed in 947us (1176us total) trans 4294967390 rc 301/301 00000100:00100000:2.0:1789760757.878135:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:1.0:1789760757.884173:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760757.884317:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863156480 00000100:00100000:3.0:1789760757.884327:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863156480 00000100:00100000:3.0:1789760757.884433:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:3.0:1789760757.884443:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24767e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+22:11111:x1876699863156480:12345-192.168.203.12@tcp:37:rm.0 00000100:00100000:3.0:1789760757.892727:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24767e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+22:11111:x1876699863156480:12345-192.168.203.12@tcp:37:rm.0 Request processed in 8275us (8553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760757.892740:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:2.0:1789760757.898478:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760757.898681:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863156736 00000100:00100000:0.0:1789760757.898692:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863156736 00000100:00100000:0.0:1789760757.899443:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:0.0:1789760757.899456:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ac29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+22:11111:x1876699863156736:12345-192.168.203.12@tcp:35:rm.0 00000100:00100000:0.0:1789760757.900226:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ac29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+23:11111:x1876699863156736:12345-192.168.203.12@tcp:35:rm.0 Request processed in 771us (1753us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1789760757.900235:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:1.0:1789760757.908402:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760757.908508:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863156992 00000100:00100000:2.0:1789760757.908519:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863156992 00000100:00100000:2.0:1789760757.908649:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:2.0:1789760757.908660:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2517f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+23:11111:x1876699863156992:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:2.0:1789760757.908687:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760757.908707:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04aeb4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d316 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.908858:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2200/0x3e099f5ef04aeb54 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.908872:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2200/0x3e099f5ef04aeb54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.908884:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2200/0x3e099f5ef04aeb54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760757.908895:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 16384 00010000:00010000:2.0:1789760757.909006:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04aeb4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d316 expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.909025:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2200/0x3e099f5ef04aeb54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d316 expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.909034:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df2502f3500) 00010000:00010000:2.0:1789760757.909037:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789760757.909041:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2517f2200, rc 0) 00000100:00100000:2.0:1789760757.909094:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2517f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+25:11111:x1876699863156992:12345-192.168.203.12@tcp:101:rm.0 Request processed in 436us (702us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1789760757.909122:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:3.0:1789760757.913652:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760757.913845:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863157120 00000100:00100000:1.0:1789760757.913855:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863157120 00000100:00100000:1.0:1789760757.913915:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:1.0:1789760757.913925:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+25:11111:x1876699863157120:12345-192.168.203.12@tcp:41:rm.0 00000004:00000024:1.0:1789760757.913989:0:7279:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7673479168 00000100:00100000:1.0:1789760757.914067:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+25:11111:x1876699863157120:12345-192.168.203.12@tcp:41:rm.0 Request processed in 142us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760757.914081:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:1.0:1789760757.918238:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760757.919022:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863157376 00000100:00100000:0.0:1789760757.919034:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863157376 00000100:00100000:0.0:1789760757.919101:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:0.0:1789760757.919112:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2517f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+25:11111:x1876699863157376:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:0.0:1789760757.919164:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789760757.919191:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3c00/0x3e099f5ef04aead6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2d0 expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.919224:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbfa00/0x3e099f5ef04ae939 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1fe expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.919235:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff8df245dcc800) 00010000:00010000:0.0:1789760757.919250:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c800/0x3e099f5ef04aeb38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d308 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.919257:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df2502f3500) 00010000:00010000:0.0:1789760757.919260:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760757.919278:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ca00/0x3e099f5ef04aeb62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.919317:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ca00/0x3e099f5ef04aeb62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.919327:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ca00/0x3e099f5ef04aeb62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.919354:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c600/0x3e099f5ef04aeb69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.919362:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c600/0x3e099f5ef04aeb69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.919368:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c600/0x3e099f5ef04aeb69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.919660:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d600/0x3e099f5ef04aeb70 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.919667:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d600/0x3e099f5ef04aeb70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.919676:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d600/0x3e099f5ef04aeb70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789760757.920573:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1789760757.920583:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 362033780703ns, next at 363033778548ns, rc = 0 00000040:00080000:0.0:1789760757.920740:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1789760757.920748:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 362033945408ns, next at 363033944043ns, rc = 0 00010000:00010000:0.0:1789760757.920840:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c200/0x3e099f5ef04aeb77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.920862:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c200/0x3e099f5ef04aeb77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.920872:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c200/0x3e099f5ef04aeb77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.920879:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c200/0x3e099f5ef04aeb77 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.920884:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c200/0x3e099f5ef04aeb77 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.920890:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c200/0x3e099f5ef04aeb77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.921134:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789760757.921152:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d600/0x3e099f5ef04aeb70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.921157:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d600/0x3e099f5ef04aeb70 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.921163:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d600/0x3e099f5ef04aeb70 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.921169:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627d600 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760757.921173:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d600/0x3e099f5ef04aeb70 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.921180:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d600/0x3e099f5ef04aeb70 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.921222:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff8df2502f3300) 00010000:00010000:0.0:1789760757.921225:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789760757.921230:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d600/0x3e099f5ef04aeb70 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.921237:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d600/0x3e099f5ef04aeb70 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.921253:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ca00/0x3e099f5ef04aeb62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.921260:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ca00/0x3e099f5ef04aeb62 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.921266:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ca00/0x3e099f5ef04aeb62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.921271:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627ca00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760757.921273:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ca00/0x3e099f5ef04aeb62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.921279:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ca00/0x3e099f5ef04aeb62 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.921285:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df2502f3500) 00010000:00010000:0.0:1789760757.921288:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760757.921290:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ca00/0x3e099f5ef04aeb62 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760757.921296:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ca00/0x3e099f5ef04aeb62 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789760757.921317:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081b679ad reply state 00000000b6a5f3bb transno 4294967393 ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c600/0x3e099f5ef04aeb69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760757.921330:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789760757.921382:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789760757.921388:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c200/0x3e099f5ef04aeb77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760757.921395:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627c200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760757.921399:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c200/0x3e099f5ef04aeb77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760757.921405:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c200/0x3e099f5ef04aeb77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760757.921414:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff8df2502f3300) 00010000:00010000:1.0:1789760757.921417:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789760757.921420:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c200/0x3e099f5ef04aeb77 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760757.921425:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c200/0x3e099f5ef04aeb77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760757.921438:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760757.921440:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760757.921442:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760757.921465:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2517f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+24:11111:x1876699863157376:12345-192.168.203.12@tcp:36:rm.0 Request processed in 2351us (3232us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1789760757.921474:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 124 00010000:00010000:3.0:1789760757.925335:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c600/0x3e099f5ef04aeb69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.925350:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c600/0x3e099f5ef04aeb69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.925357:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c600/0x3e099f5ef04aeb69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.925363:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627c600 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760757.925367:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c600/0x3e099f5ef04aeb69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.925375:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c600/0x3e099f5ef04aeb69 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.925391:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0xe7cddcd6 (ffff8df2502f3c00) 00010000:00010000:3.0:1789760757.925394:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760757.925398:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c600/0x3e099f5ef04aeb69 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.925404:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c600/0x3e099f5ef04aeb69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0xe7cddcd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760757.928667:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760757.928743:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863157632 00000100:00100000:3.0:1789760757.928754:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863157632 00000100:00100000:3.0:1789760757.928854:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:3.0:1789760757.928866:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2517f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+23:11111:x1876699863157632:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:3.0:1789760757.928928:0:7279:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789760757.928950:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3a00/0x3e099f5ef04aea4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d260 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.928979:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2e00/0x3e099f5ef04ae978 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d20c expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.928985:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df250325600) 00010000:00010000:3.0:1789760757.928994:0:7279:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789760757.929011:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5e00/0x3e099f5ef04aeb7e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.929022:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5e00/0x3e099f5ef04aeb7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.929029:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5e00/0x3e099f5ef04aeb7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.929037:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4c00/0x3e099f5ef04aeb85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.929042:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4c00/0x3e099f5ef04aeb85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.929047:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4c00/0x3e099f5ef04aeb85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.929152:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4e00/0x3e099f5ef04aeb8c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.929161:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4e00/0x3e099f5ef04aeb8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.929167:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4e00/0x3e099f5ef04aeb8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789760757.929789:0:7279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 64 off8576 00000040:00080000:3.0:1789760757.929838:0:7279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 64 off8576 00010000:00010000:3.0:1789760757.929899:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5a00/0x3e099f5ef04aeb93 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.929909:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5a00/0x3e099f5ef04aeb93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.929918:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5a00/0x3e099f5ef04aeb93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.929931:0:7279:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5a00/0x3e099f5ef04aeb93 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.929937:0:7279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5a00/0x3e099f5ef04aeb93 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.929943:0:7279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5a00/0x3e099f5ef04aeb93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.929969:0:7279:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789760757.929987:0:7279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4e00/0x3e099f5ef04aeb8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.929992:0:7279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4e00/0x3e099f5ef04aeb8c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.929996:0:7279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4e00/0x3e099f5ef04aeb8c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.929999:0:7279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c4e00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760757.930003:0:7279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4e00/0x3e099f5ef04aeb8c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.930014:0:7279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4e00/0x3e099f5ef04aeb8c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.930023:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df245dcc700) 00010000:00010000:3.0:1789760757.930025:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789760757.930027:0:7279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4e00/0x3e099f5ef04aeb8c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.930031:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4e00/0x3e099f5ef04aeb8c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.930043:0:7279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5e00/0x3e099f5ef04aeb7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.930048:0:7279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5e00/0x3e099f5ef04aeb7e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.930053:0:7279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5e00/0x3e099f5ef04aeb7e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.930058:0:7279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c5e00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760757.930061:0:7279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5e00/0x3e099f5ef04aeb7e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.930066:0:7279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5e00/0x3e099f5ef04aeb7e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.930073:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df2502f3500) 00010000:00010000:3.0:1789760757.930075:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760757.930078:0:7279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5e00/0x3e099f5ef04aeb7e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.930093:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5e00/0x3e099f5ef04aeb7e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760757.930103:0:7279:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000022ba4813 reply state 000000000c35f91b transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4c00/0x3e099f5ef04aeb85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760757.930111:0:7279:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789760757.930184:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2517f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+23:11111:x1876699863157632:12345-192.168.203.12@tcp:36:rm.0 Request processed in 1318us (1522us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1789760757.930193:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 125 00010000:00010000:2.0:1789760757.930348:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789760757.930356:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5a00/0x3e099f5ef04aeb93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.930362:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c5a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760757.930366:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5a00/0x3e099f5ef04aeb93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.930373:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5a00/0x3e099f5ef04aeb93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.930382:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8df245dcc700) 00010000:00010000:2.0:1789760757.930385:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789760757.930388:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5a00/0x3e099f5ef04aeb93 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.930393:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5a00/0x3e099f5ef04aeb93 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.930406:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760757.930408:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760757.930410:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760757.932985:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4c00/0x3e099f5ef04aeb85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.933003:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4c00/0x3e099f5ef04aeb85 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.933011:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4c00/0x3e099f5ef04aeb85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.933036:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c4c00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760757.933042:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4c00/0x3e099f5ef04aeb85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.933049:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4c00/0x3e099f5ef04aeb85 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.933065:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x572a2e26 (ffff8df245dccc00) 00010000:00010000:2.0:1789760757.933068:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760757.933071:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4c00/0x3e099f5ef04aeb85 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.933077:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4c00/0x3e099f5ef04aeb85 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x572a2e26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760757.933781:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760757.934005:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863157888 00000100:00100000:3.0:1789760757.934014:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863157888 00000100:00100000:3.0:1789760757.934100:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:3.0:1789760757.934109:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+22:11111:x1876699863157888:12345-192.168.203.12@tcp:35:rm.0 00000100:00100000:3.0:1789760757.934339:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+23:11111:x1876699863157888:12345-192.168.203.12@tcp:35:rm.0 Request processed in 230us (561us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1789760757.934347:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:0.0:1789760757.936117:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760757.936197:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863158144 00000100:00100000:2.0:1789760757.936219:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863158144 00000100:00100000:2.0:1789760757.936271:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:2.0:1789760757.936281:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df244d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+23:11111:x1876699863158144:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:2.0:1789760757.936334:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789760757.936361:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2200/0x3e099f5ef04aeb54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d316 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.936381:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2778e9200/0x3e099f5ef04ae908 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1f0 expref: 22 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.936393:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df2502f3500) 00010000:00010000:2.0:1789760757.936407:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df277dbe800/0x3e099f5ef04ae8a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d1db expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.936429:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df245dcc300) 00010000:00010000:2.0:1789760757.936437:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789760757.936459:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04aeb9a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.936472:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04aeb9a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.936482:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04aeb9a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.936495:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3e00/0x3e099f5ef04aeba1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.936501:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3e00/0x3e099f5ef04aeba1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.936507:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3e00/0x3e099f5ef04aeba1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.936739:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3c00/0x3e099f5ef04aeba8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.936748:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3c00/0x3e099f5ef04aeba8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.936756:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3c00/0x3e099f5ef04aeba8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760757.937325:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 16384 00010000:00010000:2.0:1789760757.937338:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3c00/0x3e099f5ef04aeba8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.937349:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3c00/0x3e099f5ef04aeba8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.937355:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3c00/0x3e099f5ef04aeba8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.937360:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3c00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760757.937363:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3c00/0x3e099f5ef04aeba8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.937370:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3c00/0x3e099f5ef04aeba8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.937380:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8df250325a00) 00010000:00010000:2.0:1789760757.937383:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789760757.937386:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3c00/0x3e099f5ef04aeba8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.937391:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3c00/0x3e099f5ef04aeba8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.937410:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04aeb9a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.937415:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04aeb9a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.937420:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04aeb9a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.937423:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3600 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760757.937431:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04aeb9a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.937438:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04aeb9a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.937445:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df250325b00) 00010000:00010000:2.0:1789760757.937448:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760757.937450:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04aeb9a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.937456:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3600/0x3e099f5ef04aeb9a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760757.937467:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e376ea9 reply state 00000000b1b403e4 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3e00/0x3e099f5ef04aeba1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760757.937475:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789760757.937551:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df244d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+22:11111:x1876699863158144:12345-192.168.203.12@tcp:36:rm.0 Request processed in 1270us (1439us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1789760757.937560:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 126 00010000:00010000:3.0:1789760757.940183:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3e00/0x3e099f5ef04aeba1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.940199:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3e00/0x3e099f5ef04aeba1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.940216:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3e00/0x3e099f5ef04aeba1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.940222:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3e00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760757.940227:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3e00/0x3e099f5ef04aeba1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.940250:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3e00/0x3e099f5ef04aeba1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.940266:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff8df250325d00) 00010000:00010000:3.0:1789760757.940269:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760757.940274:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3e00/0x3e099f5ef04aeba1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760757.940280:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3e00/0x3e099f5ef04aeba1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760757.968437:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760758.598531:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760758.598673:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863158272 00000100:00100000:1.0:1789760758.598683:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863158272 00000100:00100000:1.0:1789760758.598737:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 127 00000100:00100000:1.0:1789760758.598747:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df244d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+21:11122:x1876699863158272:12345-192.168.203.12@tcp:101:mkdir.0 00010000:00010000:1.0:1789760758.598777:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760758.598797:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861ec00/0x3e099f5ef04aebaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d31d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.599024:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861fe00/0x3e099f5ef04aebb6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.599039:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861fe00/0x3e099f5ef04aebb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.599050:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861fe00/0x3e099f5ef04aebb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789760758.599152:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789760758.599157:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789760758.599179:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861fe00/0x3e099f5ef04aebb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.599213:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861ec00/0x3e099f5ef04aebaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d31d expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.599230:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861fe00/0x3e099f5ef04aebb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d31d expref: 22 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.599238:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df25b60d200) 00010000:00010000:1.0:1789760758.599241:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789760758.599244:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df25861fe00, rc 0) 00000100:00100000:1.0:1789760758.599340:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df244d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+22:11122:x1876699863158272:12345-192.168.203.12@tcp:101:mkdir.0 Request processed in 593us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760758.599357:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 127 00000100:00100000:3.0:1789760758.606320:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760758.607794:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863158528 00000100:00100000:2.0:1789760758.608513:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863158528 00000100:00100000:2.0:1789760758.608640:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 128 00000100:00100000:2.0:1789760758.608651:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+22:11122:x1876699863158528:12345-192.168.203.12@tcp:36:mkdir.0 00010000:00010000:2.0:1789760758.608709:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760758.608736:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861fe00/0x3e099f5ef04aebb6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d31d expref: 22 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.608767:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df25b60d200) 00010000:00010000:2.0:1789760758.608779:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789760758.608876:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2600/0x3e099f5ef04aebbd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.608889:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2600/0x3e099f5ef04aebbd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.608899:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2600/0x3e099f5ef04aebbd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.608912:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04aebc4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.608930:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04aebc4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.608937:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04aebc4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760758.611345:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 16384 00010000:00010000:2.0:1789760758.611363:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2600/0x3e099f5ef04aebbd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.611373:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2600/0x3e099f5ef04aebbd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.611380:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2600/0x3e099f5ef04aebbd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.611387:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2600 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760758.611402:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2600/0x3e099f5ef04aebbd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.611409:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2600/0x3e099f5ef04aebbd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.611705:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df250325b00) 00010000:00010000:2.0:1789760758.611710:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760758.611715:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2600/0x3e099f5ef04aebbd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.611721:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2600/0x3e099f5ef04aebbd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760758.611743:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b6bb47a reply state 00000000aef7728e transno 4294967397 ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04aebc4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760758.611752:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789760758.612501:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+23:11122:x1876699863158528:12345-192.168.203.12@tcp:36:mkdir.0 Request processed in 3847us (6184us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1789760758.612511:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 128 00010000:00010000:2.0:1789760758.616902:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04aebc4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.616931:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04aebc4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.616939:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04aebc4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.616946:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2000 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760758.616951:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04aebc4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.616969:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04aebc4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.616984:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff8df250325a00) 00010000:00010000:2.0:1789760758.616986:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760758.616992:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04aebc4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.616997:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04aebc4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760758.625258:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760758.625582:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863158656 00000100:00100000:0.0:1789760758.625591:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863158656 00000100:00100000:0.0:1789760758.625645:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 129 00000100:00100000:0.0:1789760758.625656:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+22:11123:x1876699863158656:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1789760758.625678:0:7279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760758.625700:0:7279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d600/0x3e099f5ef04aebcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d324 expref: -99 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.625758:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c800/0x3e099f5ef04aebd2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.625772:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c800/0x3e099f5ef04aebd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.625783:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c800/0x3e099f5ef04aebd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760758.625839:0:7279:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789760758.625843:0:7279:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789760758.625874:0:7279:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c800/0x3e099f5ef04aebd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.625898:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d600/0x3e099f5ef04aebcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d324 expref: 24 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.625916:0:7279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c800/0x3e099f5ef04aebd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d324 expref: 23 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.625935:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df2502f3f00) 00010000:00010000:0.0:1789760758.625938:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789760758.625941:0:7279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df24627c800, rc 0) 00000100:00100000:0.0:1789760758.625989:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+23:11123:x1876699863158656:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 335us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760758.625997:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 129 00000100:00100000:3.0:1789760758.630262:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760758.630390:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863158912 00000100:00100000:0.0:1789760758.630401:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863158912 00000100:00100000:0.0:1789760758.630461:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 130 00000100:00100000:0.0:1789760758.630471:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+23:11123:x1876699863158912:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1789760758.630490:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760758.630493:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789760758.630515:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c800/0x3e099f5ef04aebd2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d324 expref: 23 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.630532:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df2502f3f00) 00010000:00010000:0.0:1789760758.630542:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760758.630556:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d400/0x3e099f5ef04aebd9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d32b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.630696:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d200/0x3e099f5ef04aebe0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.630707:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d200/0x3e099f5ef04aebe0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.630717:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d200/0x3e099f5ef04aebe0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.630729:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627de00/0x3e099f5ef04aebe7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.630736:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627de00/0x3e099f5ef04aebe7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.630742:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627de00/0x3e099f5ef04aebe7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.630840:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627da00/0x3e099f5ef04aebee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.630849:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627da00/0x3e099f5ef04aebee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.630857:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627da00/0x3e099f5ef04aebee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760758.630865:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 16384 00010000:00010000:0.0:1789760758.630878:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627da00/0x3e099f5ef04aebee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.630885:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627da00/0x3e099f5ef04aebee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.630899:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627da00/0x3e099f5ef04aebee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.630904:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627da00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760758.630908:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627da00/0x3e099f5ef04aebee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.630916:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627da00/0x3e099f5ef04aebee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.630937:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff8df2502f3600) 00010000:00010000:0.0:1789760758.630940:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760758.630944:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627da00/0x3e099f5ef04aebee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.630950:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627da00/0x3e099f5ef04aebee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.630967:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d200/0x3e099f5ef04aebe0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.630973:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d200/0x3e099f5ef04aebe0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.630978:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d200/0x3e099f5ef04aebe0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.630983:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627d200 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760758.630986:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d200/0x3e099f5ef04aebe0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.631002:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d200/0x3e099f5ef04aebe0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.631011:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df2502f3700) 00010000:00010000:0.0:1789760758.631013:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760758.631016:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d200/0x3e099f5ef04aebe0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.631022:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d200/0x3e099f5ef04aebe0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.631031:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627de00/0x3e099f5ef04aebe7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.631037:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627de00/0x3e099f5ef04aebe7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.631043:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627de00/0x3e099f5ef04aebe7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.631048:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627de00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760758.631051:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627de00/0x3e099f5ef04aebe7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.631056:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627de00/0x3e099f5ef04aebe7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.631062:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff8df2502f3400) 00010000:00010000:0.0:1789760758.631065:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760758.631067:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627de00/0x3e099f5ef04aebe7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.631267:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627de00/0x3e099f5ef04aebe7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.631298:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d400/0x3e099f5ef04aebd9 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d32b expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.631308:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df2502f3700) 00010000:00010000:0.0:1789760758.631310:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760758.631314:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d400/0x3e099f5ef04aebd9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d32b expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.631326:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df24627d400, rc 0) 00000100:00100000:0.0:1789760758.631385:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+22:11123:x1876699863158912:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 914us (1128us total) trans 0 rc 301/301 00000100:00100000:0.0:1789760758.631393:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 130 00000100:00100000:0.0:1789760758.636382:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760758.636453:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863159040 00000100:00100000:3.0:1789760758.636463:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863159040 00000100:00100000:3.0:1789760758.636521:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 131 00000100:00100000:3.0:1789760758.636539:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df244d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+22:11123:x1876699863159040:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1789760758.636556:0:7279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760758.636573:0:7279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5e00/0x3e099f5ef04aebf5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d332 expref: -99 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.636630:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4e00/0x3e099f5ef04aebfc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.636641:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4e00/0x3e099f5ef04aebfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.636649:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4e00/0x3e099f5ef04aebfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760758.636683:0:7279:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789760758.636686:0:7279:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789760758.636700:0:7279:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4e00/0x3e099f5ef04aebfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.636724:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5e00/0x3e099f5ef04aebf5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d332 expref: 24 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.636739:0:7279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4e00/0x3e099f5ef04aebfc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d332 expref: 23 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.636747:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df245dcc900) 00010000:00010000:3.0:1789760758.637006:0:7279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789760758.637011:0:7279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2687c4e00, rc 0) 00000100:00100000:3.0:1789760758.637061:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df244d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+23:11123:x1876699863159040:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 532us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760758.637068:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 131 00000100:00100000:3.0:1789760758.643546:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760758.643725:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863159296 00000100:00100000:1.0:1789760758.643734:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863159296 00000100:00100000:1.0:1789760758.643788:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 132 00000100:00100000:1.0:1789760758.643799:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277cd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+23:11123:x1876699863159296:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1789760758.643837:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760758.643855:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861fc00/0x3e099f5ef04aec03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d339 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.643933:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861fe00/0x3e099f5ef04aec0a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.643947:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861fe00/0x3e099f5ef04aec0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.643960:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861fe00/0x3e099f5ef04aec0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.643975:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861ec00/0x3e099f5ef04aec11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.643982:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861ec00/0x3e099f5ef04aec11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.643989:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861ec00/0x3e099f5ef04aec11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789760758.644106:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 16384 00010000:00010000:1.0:1789760758.644182:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861fe00/0x3e099f5ef04aec0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.644284:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861fe00/0x3e099f5ef04aec0a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.644292:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861fe00/0x3e099f5ef04aec0a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.644299:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861fe00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:1.0:1789760758.644303:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861fe00/0x3e099f5ef04aec0a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.644311:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861fe00/0x3e099f5ef04aec0a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.644322:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df245dcc900) 00010000:00010000:1.0:1789760758.644325:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760758.644329:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861fe00/0x3e099f5ef04aec0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.644335:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861fe00/0x3e099f5ef04aec0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.644346:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861ec00/0x3e099f5ef04aec11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.644352:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861ec00/0x3e099f5ef04aec11 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.644357:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861ec00/0x3e099f5ef04aec11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.644363:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861ec00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:1.0:1789760758.644372:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861ec00/0x3e099f5ef04aec11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.644378:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861ec00/0x3e099f5ef04aec11 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.644386:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff8df25b60d500) 00010000:00010000:1.0:1789760758.644389:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760758.644392:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861ec00/0x3e099f5ef04aec11 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.644398:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861ec00/0x3e099f5ef04aec11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.644432:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861fc00/0x3e099f5ef04aec03 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d339 expref: 25 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.644442:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df245dcc900) 00010000:00010000:1.0:1789760758.644444:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789760758.644448:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861fc00/0x3e099f5ef04aec03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d339 expref: 25 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.644457:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df25861fc00, rc 0) 00000100:00100000:1.0:1789760758.644520:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277cd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+24:11123:x1876699863159296:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 723us (983us total) trans 4294967398 rc 301/301 00000100:00100000:1.0:1789760758.644527:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 132 00000100:00100000:3.0:1789760758.647407:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760758.647764:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863159552 00000100:00100000:1.0:1789760758.647773:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863159552 00000100:00100000:1.0:1789760758.647848:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 133 00000100:00100000:1.0:1789760758.647859:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cb22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+24:11123:x1876699863159552:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:1.0:1789760758.648189:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f800/0x3e099f5ef04aec1f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.648215:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f800/0x3e099f5ef04aec1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.648226:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f800/0x3e099f5ef04aec1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789760758.648542:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2a3eaad reply state 000000000877c7bf transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f800/0x3e099f5ef04aec1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760758.648553:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789760758.648560:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 16384 00000100:00100000:1.0:1789760758.648736:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cb22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+26:11123:x1876699863159552:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 876us (1347us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1789760758.648745:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 133 00010000:00010000:3.0:1789760758.651372:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f800/0x3e099f5ef04aec1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.651556:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f800/0x3e099f5ef04aec1f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.651565:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f800/0x3e099f5ef04aec1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.651572:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861f800 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760758.651584:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f800/0x3e099f5ef04aec1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.651593:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f800/0x3e099f5ef04aec1f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.651609:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff8df25b60d400) 00010000:00010000:3.0:1789760758.651612:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789760758.651616:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f800/0x3e099f5ef04aec1f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.651623:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861f800/0x3e099f5ef04aec1f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760758.652905:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760758.653011:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863159808 00000100:00100000:0.0:1789760758.653022:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863159808 00000100:00100000:0.0:1789760758.653081:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:0.0:1789760758.653091:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+25:11123:x1876699863159808:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1789760758.653335:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+26:11123:x1876699863159808:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 244us (437us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1789760758.653344:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:2.0:1789760758.668939:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760758.671605:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863159936 00000100:00100000:3.0:1789760758.671619:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863159936 00000100:00100000:3.0:1789760758.671874:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 134 00000100:00100000:3.0:1789760758.671886:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ac2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+26:11124:x1876699863159936:12345-192.168.203.12@tcp:101:chmod.0 00010000:00010000:3.0:1789760758.671910:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760758.671932:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4200/0x3e099f5ef04aec26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d340 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.671998:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5e00/0x3e099f5ef04aec2d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.672012:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5e00/0x3e099f5ef04aec2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.672023:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5e00/0x3e099f5ef04aec2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.672047:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5800/0x3e099f5ef04aec34 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.672054:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5800/0x3e099f5ef04aec34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.672060:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5800/0x3e099f5ef04aec34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.672150:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4800/0x3e099f5ef04aec3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.672159:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4800/0x3e099f5ef04aec3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.672165:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4800/0x3e099f5ef04aec3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789760758.672195:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 16384 00000004:00200000:3.0:1789760758.672208:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789760758.672226:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4800/0x3e099f5ef04aec3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.672237:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5e00/0x3e099f5ef04aec2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.672243:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5e00/0x3e099f5ef04aec2d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.672249:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5e00/0x3e099f5ef04aec2d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.672264:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c5e00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760758.672268:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5e00/0x3e099f5ef04aec2d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.672274:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5e00/0x3e099f5ef04aec2d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.672285:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df245dcc900) 00010000:00010000:3.0:1789760758.672288:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760758.672292:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5e00/0x3e099f5ef04aec2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.672297:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5e00/0x3e099f5ef04aec2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.672308:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5800/0x3e099f5ef04aec34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.672314:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5800/0x3e099f5ef04aec34 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.672319:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5800/0x3e099f5ef04aec34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.672323:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c5800 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760758.672326:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5800/0x3e099f5ef04aec34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.672331:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5800/0x3e099f5ef04aec34 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.672346:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff8df245dcc400) 00010000:00010000:3.0:1789760758.672348:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760758.672363:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5800/0x3e099f5ef04aec34 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.672370:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c5800/0x3e099f5ef04aec34 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.672401:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4200/0x3e099f5ef04aec26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d340 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.672415:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4800/0x3e099f5ef04aec3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d340 expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.672422:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff8df245dcc500) 00010000:00010000:3.0:1789760758.672425:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789760758.672427:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2687c4800, rc 0) 00000100:00100000:3.0:1789760758.672499:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ac2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+27:11124:x1876699863159936:12345-192.168.203.12@tcp:101:chmod.0 Request processed in 615us (3567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760758.672506:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 134 00000100:00100000:2.0:1789760758.676903:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760758.676980:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863160192 00000100:00100000:3.0:1789760758.676990:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863160192 00000100:00100000:3.0:1789760758.677061:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 135 00000100:00100000:3.0:1789760758.677072:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ac28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+27:11124:x1876699863160192:12345-192.168.203.12@tcp:36:chmod.0 00010000:00010000:3.0:1789760758.677127:0:7279:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760758.677156:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4800/0x3e099f5ef04aec3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d340 expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.677188:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff8df245dcc500) 00010000:00010000:3.0:1789760758.677210:0:7279:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789760758.677236:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4400/0x3e099f5ef04aec42 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.677249:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4400/0x3e099f5ef04aec42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.677259:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4400/0x3e099f5ef04aec42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789760758.677481:0:7279:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aac8d400 reply state 00000000c265ac50 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4400/0x3e099f5ef04aec42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760758.677490:0:7279:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789760758.677497:0:7279:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 16384 00000100:00100000:3.0:1789760758.677580:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ac28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+28:11124:x1876699863160192:12345-192.168.203.12@tcp:36:chmod.0 Request processed in 509us (685us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1789760758.677588:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 135 00010000:00010000:0.0:1789760758.679856:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4400/0x3e099f5ef04aec42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.679870:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4400/0x3e099f5ef04aec42 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.679890:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4400/0x3e099f5ef04aec42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.679897:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c4400 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760758.679901:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4400/0x3e099f5ef04aec42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.679910:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4400/0x3e099f5ef04aec42 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.679935:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff8df245dcc300) 00010000:00010000:0.0:1789760758.679938:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789760758.679943:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4400/0x3e099f5ef04aec42 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.679950:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4400/0x3e099f5ef04aec42 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760758.700436:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760758.700478:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863160320 00000100:00100000:2.0:1789760758.700487:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863160320 00000100:00100000:2.0:1789760758.700540:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 136 00000100:00100000:2.0:1789760758.700550:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ac2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+27:11125:x1876699863160320:12345-192.168.203.12@tcp:101:touch.500 00010000:00010000:2.0:1789760758.700573:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760758.700593:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3000/0x3e099f5ef04aec49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d347 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.700669:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04aec50 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.700683:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04aec50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.700693:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04aec50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.700716:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2a00/0x3e099f5ef04aec57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.700724:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2a00/0x3e099f5ef04aec57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.700732:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2a00/0x3e099f5ef04aec57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.700860:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2600/0x3e099f5ef04aec5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.700869:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2600/0x3e099f5ef04aec5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.700878:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2600/0x3e099f5ef04aec5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760758.700897:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 16384 00000004:00200000:2.0:1789760758.700901:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789760758.700919:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2600/0x3e099f5ef04aec5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.700930:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04aec50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.700937:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04aec50 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.700943:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04aec50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.700959:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3800 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760758.700964:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04aec50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.700972:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04aec50 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.700987:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df245dcc900) 00010000:00010000:2.0:1789760758.700990:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760758.700995:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04aec50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.701001:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04aec50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.701015:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2a00/0x3e099f5ef04aec57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.701021:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2a00/0x3e099f5ef04aec57 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.701027:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2a00/0x3e099f5ef04aec57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.701033:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2a00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760758.701036:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2a00/0x3e099f5ef04aec57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.701043:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2a00/0x3e099f5ef04aec57 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.701064:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff8df250325a00) 00010000:00010000:2.0:1789760758.701066:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760758.701069:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2a00/0x3e099f5ef04aec57 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.701074:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2a00/0x3e099f5ef04aec57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.701106:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3000/0x3e099f5ef04aec49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d347 expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.701119:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2600/0x3e099f5ef04aec5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d347 expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.701125:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff8df250325b00) 00010000:00010000:2.0:1789760758.701127:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789760758.701130:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2517f2600, rc 0) 00000100:00100000:2.0:1789760758.701209:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ac2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+28:11125:x1876699863160320:12345-192.168.203.12@tcp:101:touch.500 Request processed in 649us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760758.701217:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 136 00000100:00100000:2.0:1789760758.704732:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760758.704773:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863160576 00000100:00100000:2.0:1789760758.704783:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863160576 00000100:00100000:2.0:1789760758.704853:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 137 00000100:00100000:2.0:1789760758.704863:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ac2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+28:11125:x1876699863160576:12345-192.168.203.12@tcp:101:touch.500 00010000:00010000:2.0:1789760758.704881:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760758.704898:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04aec65 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d34e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.705027:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3400/0x3e099f5ef04aec6c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.705040:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3400/0x3e099f5ef04aec6c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.705052:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3400/0x3e099f5ef04aec6c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.705106:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3200/0x3e099f5ef04aec73 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.705115:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3200/0x3e099f5ef04aec73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.705121:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3200/0x3e099f5ef04aec73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789760758.706178:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7:0x0], index 0: 0 00010000:00010000:2.0:1789760758.706716:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2400/0x3e099f5ef04aec7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.706730:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2400/0x3e099f5ef04aec7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.706740:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2400/0x3e099f5ef04aec7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.706773:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3400/0x3e099f5ef04aec6c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.706791:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3400/0x3e099f5ef04aec6c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.706798:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3400/0x3e099f5ef04aec6c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.706910:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3400 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760758.706915:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3400/0x3e099f5ef04aec6c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.706923:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3400/0x3e099f5ef04aec6c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.706936:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff8df250325b00) 00010000:00010000:2.0:1789760758.706939:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760758.706943:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3400/0x3e099f5ef04aec6c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.706950:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3400/0x3e099f5ef04aec6c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760758.706963:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b7b9b55 reply state 00000000dd1d2449 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3200/0x3e099f5ef04aec73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760758.706972:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789760758.707018:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04aec65 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d34e expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.707038:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2400/0x3e099f5ef04aec7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d34e expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.707056:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff8df250325700) 00010000:00010000:2.0:1789760758.707059:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789760758.707062:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2517f2400, rc 0) 00000100:00100000:2.0:1789760758.707138:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ac2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+31:11125:x1876699863160576:12345-192.168.203.12@tcp:101:touch.500 Request processed in 2275us (2414us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1789760758.707149:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 137 00010000:00010000:0.0:1789760758.709668:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3200/0x3e099f5ef04aec73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.709683:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3200/0x3e099f5ef04aec73 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.709691:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3200/0x3e099f5ef04aec73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.709697:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3200 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760758.709701:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3200/0x3e099f5ef04aec73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.709720:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3200/0x3e099f5ef04aec73 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.709736:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x4009f790 (ffff8df250325200) 00010000:00010000:0.0:1789760758.709739:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760758.709743:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3200/0x3e099f5ef04aec73 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.709749:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3200/0x3e099f5ef04aec73 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760758.712417:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760758.712587:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863160832 00000100:00100000:1.0:1789760758.712598:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863160832 00000100:00100000:1.0:1789760758.712656:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 138 00000100:00100000:1.0:1789760758.712667:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ac2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+30:11125:x1876699863160832:12345-192.168.203.12@tcp:36:touch.500 00010000:00010000:1.0:1789760758.712723:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760758.712747:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2400/0x3e099f5ef04aec7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d34e expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.712766:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff8df250325700) 00010000:00010000:1.0:1789760758.712777:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789760758.712835:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861ec00/0x3e099f5ef04aec88 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.712860:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861ec00/0x3e099f5ef04aec88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.712870:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861ec00/0x3e099f5ef04aec88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789760758.713204:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005984c3a reply state 00000000ee3bfa61 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861ec00/0x3e099f5ef04aec88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760758.713216:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789760758.713302:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ac2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+31:11125:x1876699863160832:12345-192.168.203.12@tcp:36:touch.500 Request processed in 636us (893us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1789760758.713310:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 138 00000100:00100000:0.0:1789760758.715449:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00010000:00010000:2.0:1789760758.715638:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861ec00/0x3e099f5ef04aec88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.715651:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861ec00/0x3e099f5ef04aec88 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.715658:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861ec00/0x3e099f5ef04aec88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.715664:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861ec00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760758.715668:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861ec00/0x3e099f5ef04aec88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.715675:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861ec00/0x3e099f5ef04aec88 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760758.715695:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863160960 00010000:00010000:2.0:1789760758.715699:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff8df25b60d500) 00010000:00010000:2.0:1789760758.715703:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789760758.715705:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863160960 00010000:00010000:2.0:1789760758.715708:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861ec00/0x3e099f5ef04aec88 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.715717:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df25861ec00/0x3e099f5ef04aec88 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760758.715762:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 139 00000100:00100000:1.0:1789760758.715781:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df244d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+30:11125:x1876699863160960:12345-192.168.203.12@tcp:101:touch.500 00010000:00010000:1.0:1789760758.715906:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760758.716075:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d200/0x3e099f5ef04aec8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d355 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.716207:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d200/0x3e099f5ef04aec8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d355 expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.716225:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d200/0x3e099f5ef04aec8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d355 expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.716243:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff8df2502f3700) 00010000:00010000:0.0:1789760758.716247:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789760758.716250:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df24627d200, rc 0) 00000100:00100000:0.0:1789760758.716416:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df244d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+31:11125:x1876699863160960:12345-192.168.203.12@tcp:101:touch.500 Request processed in 644us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760758.716424:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 139 00000100:00100000:2.0:1789760758.719677:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760758.719739:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863161088 00000100:00100000:3.0:1789760758.719748:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863161088 00000100:00100000:3.0:1789760758.719878:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:3.0:1789760758.719892:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ac29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+47:2348:x1876699863161088:12345-192.168.203.12@tcp:2:touch.500 00000100:00080000:0.0:1789760758.719903:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760758.720181:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ac29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+48:2348:x1876699863161088:12345-192.168.203.12@tcp:2:touch.500 Request processed in 293us (509us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1789760758.720191:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:2.0:1789760758.721907:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760758.721990:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863161344 00000100:00100000:3.0:1789760758.722007:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863161344 00000100:00100000:3.0:1789760758.722089:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:3.0:1789760758.722100:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ac29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+31:11125:x1876699863161344:12345-192.168.203.12@tcp:35:touch.500 00000100:00100000:3.0:1789760758.722410:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ac29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+32:11125:x1876699863161344:12345-192.168.203.12@tcp:35:touch.500 Request processed in 312us (509us total) trans 4294967404 rc 0/0 00000100:00100000:3.0:1789760758.722417:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:0.0:1789760758.728846:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760758.728920:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863161472 00000100:00100000:2.0:1789760758.728929:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863161472 00000100:00100000:2.0:1789760758.728984:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 140 00000100:00100000:2.0:1789760758.728993:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df244d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+32:11126:x1876699863161472:12345-192.168.203.12@tcp:101:chmod.0 00010000:00010000:2.0:1789760758.729013:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760758.729031:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04aec96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d35c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.729186:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3400/0x3e099f5ef04aec9d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.729212:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3400/0x3e099f5ef04aec9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.729224:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3400/0x3e099f5ef04aec9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.729238:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2a00/0x3e099f5ef04aeca4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.729259:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2a00/0x3e099f5ef04aeca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.729266:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2a00/0x3e099f5ef04aeca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.729343:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04aecab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.729351:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04aecab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.729357:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04aecab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760758.729390:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x15:0x0]: returning size 0 00000004:00200000:2.0:1789760758.729394:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789760758.729411:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04aecab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.729421:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04aecab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.729429:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3400/0x3e099f5ef04aec9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.729435:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3400/0x3e099f5ef04aec9d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.729442:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3400/0x3e099f5ef04aec9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.729460:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3400 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760758.729464:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3400/0x3e099f5ef04aec9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.729471:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3400/0x3e099f5ef04aec9d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.729483:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff8df250325b00) 00010000:00010000:2.0:1789760758.729486:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760758.729490:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3400/0x3e099f5ef04aec9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.729496:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3400/0x3e099f5ef04aec9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.729509:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2a00/0x3e099f5ef04aeca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.729515:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2a00/0x3e099f5ef04aeca4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.729521:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2a00/0x3e099f5ef04aeca4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.729526:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2a00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760758.729529:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2a00/0x3e099f5ef04aeca4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.729535:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2a00/0x3e099f5ef04aeca4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.729567:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x4009f790 (ffff8df250325a00) 00010000:00010000:2.0:1789760758.729569:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760758.729572:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2a00/0x3e099f5ef04aeca4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.729579:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2a00/0x3e099f5ef04aeca4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.729609:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04aec96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d35c expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.729621:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04aecab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d35c expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.729629:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff8df2502f3700) 00010000:00010000:2.0:1789760758.729631:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789760758.729634:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2517f3800, rc 0) 00000100:00100000:2.0:1789760758.729692:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df244d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+33:11126:x1876699863161472:12345-192.168.203.12@tcp:101:chmod.0 Request processed in 701us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760758.729700:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 140 00000100:00100000:1.0:1789760758.733853:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760758.734251:0:12460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863161600 00000100:00100000:0.0:1789760758.734262:0:12460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863161600 00000100:00100000:0.0:1789760758.734319:0:12460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 96 00000100:00100000:0.0:1789760758.734330:0:12460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d365f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1da0113a-370d-4d79-883c-54efc174697f+48:2348:x1876699863161600:12345-192.168.203.12@tcp:101:chmod.0 00010000:00010000:0.0:1789760758.734347:0:12460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760758.734377:0:12460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b14faf1a/0x3e099f5ef04aecb2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d363 expref: -99 pid: 12460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760758.734404:0:12460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x6aad94f6, atime: 0x6aad94f6, ctime: 0x6aad94f6, blocks: 0x1 00010000:00010000:0.0:1789760758.734423:0:12460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=362s v=(0 0) 00010000:00010000:0.0:1789760758.734427:0:12460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760758.734436:0:12460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b14faf1a/0x3e099f5ef04aecb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d363 expref: 49 pid: 12460 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.734452:0:12460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b14faf1a/0x3e099f5ef04aecb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d363 expref: 49 pid: 12460 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.734463:0:12460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df24627c800, rc 0) 00000100:00100000:0.0:1789760758.734523:0:12460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d365f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1da0113a-370d-4d79-883c-54efc174697f+49:2348:x1876699863161600:12345-192.168.203.12@tcp:101:chmod.0 Request processed in 195us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760758.734529:0:12460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 96 00000100:00100000:3.0:1789760758.743614:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760758.745951:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863161856 00000100:00100000:0.0:1789760758.745966:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863161856 00000100:00100000:0.0:1789760758.746090:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 141 00000100:00100000:0.0:1789760758.746100:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14238c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+33:11126:x1876699863161856:12345-192.168.203.12@tcp:36:chmod.0 00010000:00010000:0.0:1789760758.746165:0:7279:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760758.746191:0:7279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f3800/0x3e099f5ef04aecab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d35c expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.746223:0:7279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff8df2502f3700) 00010000:00010000:0.0:1789760758.746228:0:7279:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760758.746257:0:7279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d600/0x3e099f5ef04aecb9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.746270:0:7279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d600/0x3e099f5ef04aecb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.746280:0:7279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d600/0x3e099f5ef04aecb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789760758.746467:0:7279:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c921c691 reply state 000000001c706751 transno 4294967405 ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d600/0x3e099f5ef04aecb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760758.746476:0:7279:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789760758.746563:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14238c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+34:11126:x1876699863161856:12345-192.168.203.12@tcp:36:chmod.0 Request processed in 464us (2957us total) trans 4294967405 rc 0/0 00000100:00100000:0.0:1789760758.746570:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 141 00010000:00010000:1.0:1789760758.748010:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d600/0x3e099f5ef04aecb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.748026:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d600/0x3e099f5ef04aecb9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.748033:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d600/0x3e099f5ef04aecb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.748039:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627d600 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:1.0:1789760758.748043:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d600/0x3e099f5ef04aecb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.748051:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d600/0x3e099f5ef04aecb9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.748065:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff8df2502f3700) 00010000:00010000:1.0:1789760758.748068:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789760758.748086:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d600/0x3e099f5ef04aecb9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.748093:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d600/0x3e099f5ef04aecb9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760758.748625:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760758.748936:0:12459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863161984 00000100:00100000:1.0:1789760758.748945:0:12459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863161984 00000100:00100000:1.0:1789760758.748992:0:12459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:1.0:1789760758.749001:0:12459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14238ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1da0113a-370d-4d79-883c-54efc174697f+49:2351:x1876699863161984:12345-192.168.203.12@tcp:2:chmod.0 00002000:00010000:1.0:1789760758.749178:0:12459:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789760758.749182:0:12459:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789760758 -> 1789760758 00002000:00010000:1.0:1789760758.749184:0:12459:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb atime from disk: 1789760758 -> 1789760758 00002000:00010000:1.0:1789760758.749187:0:12459:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789760758 -> 1789760758 00002000:00010000:1.0:1789760758.749189:0:12459:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789760758.749254:0:12459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14238ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1da0113a-370d-4d79-883c-54efc174697f+50:2351:x1876699863161984:12345-192.168.203.12@tcp:2:chmod.0 Request processed in 252us (632us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1789760758.749262:0:12459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:3.0:1789760758.797782:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760758.798108:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863162240 00000100:00100000:0.0:1789760758.798118:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863162240 00000100:00100000:0.0:1789760758.798297:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 142 00000100:00100000:0.0:1789760758.798308:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14238ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+33:11132:x1876699863162240:12345-192.168.203.12@tcp:101:dd.500 00010000:00010000:0.0:1789760758.798332:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760758.798352:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627cc00/0x3e099f5ef04aecc0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d36a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.798513:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627dc00/0x3e099f5ef04aecc7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.798526:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627dc00/0x3e099f5ef04aecc7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.798536:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627dc00/0x3e099f5ef04aecc7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.798549:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c000/0x3e099f5ef04aecce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.798556:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c000/0x3e099f5ef04aecce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.798563:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c000/0x3e099f5ef04aecce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.798621:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ce00/0x3e099f5ef04aecd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.798629:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ce00/0x3e099f5ef04aecd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.798647:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ce00/0x3e099f5ef04aecd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760758.798656:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x15:0x0]: returning size 0 00010000:00010000:0.0:1789760758.798748:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627dc00/0x3e099f5ef04aecc7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.798764:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627dc00/0x3e099f5ef04aecc7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.798771:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627dc00/0x3e099f5ef04aecc7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.798776:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627dc00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760758.798780:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627dc00/0x3e099f5ef04aecc7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.798788:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627dc00/0x3e099f5ef04aecc7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.798799:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff8df250325b00) 00010000:00010000:0.0:1789760758.798823:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760758.798826:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627dc00/0x3e099f5ef04aecc7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.798832:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627dc00/0x3e099f5ef04aecc7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.798844:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c000/0x3e099f5ef04aecce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.798849:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c000/0x3e099f5ef04aecce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.798855:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c000/0x3e099f5ef04aecce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.798860:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627c000 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760758.798867:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c000/0x3e099f5ef04aecce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.798873:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c000/0x3e099f5ef04aecce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.798880:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x4009f790 (ffff8df2502f3f00) 00010000:00010000:0.0:1789760758.798882:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760758.798885:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c000/0x3e099f5ef04aecce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.798890:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c000/0x3e099f5ef04aecce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.798926:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627cc00/0x3e099f5ef04aecc0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d36a expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.798938:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ce00/0x3e099f5ef04aecd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d36a expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.798945:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff8df2502f3700) 00010000:00010000:0.0:1789760758.798947:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789760758.798949:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df24627ce00, rc 0) 00000100:00100000:0.0:1789760758.799007:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14238ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+35:11132:x1876699863162240:12345-192.168.203.12@tcp:101:dd.500 Request processed in 701us (1234us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1789760758.799015:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 142 00000100:00100000:1.0:1789760758.801642:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760758.801780:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863162496 00000100:00100000:2.0:1789760758.801790:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863162496 00000100:00100000:2.0:1789760758.801860:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 143 00000100:00100000:2.0:1789760758.801870:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+35:11132:x1876699863162496:12345-192.168.203.12@tcp:36:dd.500 00010000:00010000:2.0:1789760758.801922:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760758.801949:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ce00/0x3e099f5ef04aecd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d36a expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.801991:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff8df2502f3700) 00010000:00010000:2.0:1789760758.801996:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789760758.802207:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04aece3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.802220:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04aece3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.802229:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04aece3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760758.802279:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000004:00010000:2.0:1789760758.802316:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bad8c732 reply state 00000000ee85f043 transno 4294967408 ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04aece3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760758.802325:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789760758.802418:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+37:11132:x1876699863162496:12345-192.168.203.12@tcp:36:dd.500 Request processed in 548us (784us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1789760758.802425:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 143 00000020:00080000:2.0:1789760758.802429:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789760758.804497:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04aece3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.804512:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04aece3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.804519:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04aece3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.804526:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2000 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:2.0:1789760758.804542:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04aece3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.804550:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04aece3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.804565:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff8df2502f3700) 00010000:00010000:2.0:1789760758.804568:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789760758.804572:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04aece3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.804579:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2000/0x3e099f5ef04aece3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760758.808457:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760758.808640:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863162624 00000100:00100000:2.0:1789760758.808650:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863162624 00000100:00100000:2.0:1789760758.808711:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:2.0:1789760758.808720:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+50:11132:x1876699863162624:12345-192.168.203.12@tcp:101:dd.500 00010000:00010000:2.0:1789760758.808737:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760758.808755:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aecea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d371 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.808784:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b14faf1a/0x3e099f5ef04aecb2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d363 expref: 51 pid: 12460 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.808792:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760758.808796:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760758.808835:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aecea lrc: 4/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d371 expref: 51 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.808886:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b14faf1a/0x3e099f5ef04aecb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d363 expref: 51 pid: 12460 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.808904:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b14faf1a/0x3e099f5ef04aecb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d363 expref: 51 pid: 12460 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760758.808917:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14ac29180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6694:1876699883057024:192.168.203.12@tcp:104: 00000100:00100000:2.0:1789760758.809007:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df241254240 going to sleep for 11 seconds 00000100:00100000:1.0:1789760758.811904:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760758.812242:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863162752 00000100:00100000:3.0:1789760758.812252:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863162752 00010000:00010000:3.0:1789760758.812289:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b14faf1a/0x3e099f5ef04aecb2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d363 expref: 52 pid: 12460 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760758.812340:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:3.0:1789760758.812350:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ad64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1da0113a-370d-4d79-883c-54efc174697f+52:2348:x1876699863162752:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789760758.812363:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760758.812369:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b14faf1a/0x3e099f5ef04aecb2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d363 expref: 52 pid: 12460 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.812383:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b14faf1a/0x3e099f5ef04aecb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d363 expref: 52 pid: 12460 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.812406:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760758.812410:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760758.812426:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aecea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d371 expref: 52 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.812443:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aecea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d371 expref: 52 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.812478:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aecea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d371 expref: 52 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760758.812491:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14238c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5831:1876699883057152:192.168.203.12@tcp:105: 00000100:00100000:3.0:1789760758.812560:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df27cdb4c00 going to sleep for 11 seconds 00010000:00010000:2.0:1789760758.815156:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b14faf1a/0x3e099f5ef04aecb2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d363 expref: 52 pid: 12460 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760758.815179:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14ac29180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6694:1876699883057024:192.168.203.12@tcp:104: 00010000:00010000:2.0:1789760758.815288:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aecea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d371 expref: 51 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.815304:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df2517f2a00, rc 0) 00000100:00100000:2.0:1789760758.815367:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1da0113a-370d-4d79-883c-54efc174697f+51:11132:x1876699863162624:12345-192.168.203.12@tcp:101:dd.500 Request processed in 6647us (6919us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760758.815376:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:1.0:1789760758.817449:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14238c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5831:1876699883057152:192.168.203.12@tcp:105: 00010000:00010000:1.0:1789760758.817473:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760758.817620:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ad64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1da0113a-370d-4d79-883c-54efc174697f+50:2348:x1876699863162752:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 5270us (5721us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760758.817639:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:0.0:1789760758.817948:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760758.818937:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863162880 00000100:00100000:2.0:1789760758.818948:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863162880 00002000:00010000:2.0:1789760758.818986:0:11798:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/7 (0->18446744073709551615) 00002000:00100000:2.0:1789760758.818990:0:11798:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df244d0f800 with x1876699863162880 ext(0->18446744073709551615) 00002000:00010000:2.0:1789760758.819013:0:11798:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df244d0f800. 00000100:00100000:2.0:1789760758.819026:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 361610843336 time 361611031901 state 0x0 ref 1 00000100:00100000:2.0:1789760758.819037:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 361811031901 time 361611031901 state 0x1 ref 1 00000100:00100000:2.0:1789760758.819099:0:11798:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 2 deadline 361811031901 time 362932293802 state 0x0 ref 1 00000100:00100000:2.0:1789760758.819111:0:11798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df244d0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+50:2350:x1876699863162880:12345-192.168.203.12@tcp:10:dd.500 00002000:00010000:2.0:1789760758.819362:0:11798:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789760758.819366:0:11798:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789760758 -> 1789760758 00002000:00010000:2.0:1789760758.819369:0:11798:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb atime from disk: 1789760758 -> 1789760758 00002000:00010000:2.0:1789760758.819371:0:11798:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789760758 -> 1789760758 00002000:00010000:2.0:1789760758.819373:0:11798:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789760758.819572:0:11798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df244d0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1da0113a-370d-4d79-883c-54efc174697f+51:2350:x1876699863162880:12345-192.168.203.12@tcp:10:dd.500 Request processed in 462us (1623us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1789760758.819579:0:11798:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:2.0:1789760758.819584:0:11798:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 2 deadline 361811031901 time 362932293802 state 0x2 ref 0 00002000:00010000:2.0:1789760758.819596:0:11798:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/7 (0->18446744073709551615) 00002000:00100000:2.0:1789760758.819599:0:11798:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8df244d0f800 with x1876699863162880 ext(0->18446744073709551615) 00002000:00010000:2.0:1789760758.819604:0:11798:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8df244d0f800. 00000100:00100000:3.0:1789760758.825898:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760758.826230:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863163008 00000100:00100000:0.0:1789760758.826240:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863163008 00000100:00100000:0.0:1789760758.826293:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 2 deadline 361811031901 time 362932293802 state 0x0 ref 1 00000100:00100000:0.0:1789760758.826378:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 2 deadline 363132293802 time 362932293802 state 0x1 ref 1 00000100:00100000:0.0:1789760758.826490:0:11797:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 1 deadline 363132293802 time 362939685090 state 0x0 ref 1 00000100:00100000:0.0:1789760758.826504:0:11797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14238f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+51:2349:x1876699863163008:12345-192.168.203.12@tcp:4:dd.500 00010000:00010000:0.0:1789760758.826543:0:11797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aecf1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.826562:0:11797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aecea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d371 expref: 51 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.826571:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760758.826576:0:11797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789760758.826581:0:11797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aecf1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.826619:0:11797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aecea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d371 expref: 51 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.826640:0:11797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aecea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d371 expref: 51 pid: 6694 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760758.826654:0:11797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df244d0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:11797:1876699883057280:192.168.203.12@tcp:104: 00000100:00100000:0.0:1789760758.826738:0:11797:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df258fe6300 going to sleep for 11 seconds 00000100:00100000:1.0:1789760758.829191:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760758.829291:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863163136 00000100:00100000:2.0:1789760758.829300:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863163136 00010000:00010000:2.0:1789760758.829341:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aecea lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d371 expref: 52 pid: 6694 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760758.829410:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:2.0:1789760758.829435:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ad64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1da0113a-370d-4d79-883c-54efc174697f+52:2348:x1876699863163136:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760758.829448:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760758.829469:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aecea lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d371 expref: 52 pid: 6694 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.829482:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aecea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d371 expref: 52 pid: 6694 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.829505:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789760758.829509:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789760758.829525:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aecf1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.829534:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aecf1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.829553:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760758.829610:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ad64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1da0113a-370d-4d79-883c-54efc174697f+52:2348:x1876699863163136:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 176us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760758.829617:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00010000:00010000:0.0:1789760758.829743:0:11797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aecea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d371 expref: 51 pid: 6694 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760758.829774:0:11797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df244d0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:11797:1876699883057280:192.168.203.12@tcp:104: 00010000:00010000:0.0:1789760758.829795:0:11797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aecf1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.829843:0:11797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aecf1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.829851:0:11797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aecf1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760758.946560:0:11797:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:3.0:1789760758.946570:0:11797:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:3.0:1789760758.946586:0:11797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aecf1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.946598:0:11797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aecf1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.946607:0:11797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aecf1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.946615:0:11797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627d000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760758.946620:0:11797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aecf1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.946630:0:11797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aecf1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760758.946633:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967450 is committed 00010000:00010000:3.0:1789760758.946671:0:11797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aecf1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.946679:0:11797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aecf1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760758.946779:0:11797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14238f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1da0113a-370d-4d79-883c-54efc174697f+11:2349:x1876699863163008:12345-192.168.203.12@tcp:4:dd.500 Request processed in 120273us (120885us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1789760758.946790:0:11797:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:3.0:1789760758.946798:0:11797:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 1 deadline 363132293802 time 362939685090 state 0x2 ref 0 00010000:00010000:1.0:1789760758.991721:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760758.993941:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760758.994976:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863163264 00000100:00100000:0.0:1789760758.994987:0:11799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863163264 00000100:00100000:0.0:1789760758.995054:0:11799:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 1 deadline 363132293802 time 362939685090 state 0x0 ref 1 00000100:00100000:0.0:1789760758.995067:0:11799:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 1 deadline 363139685090 time 362939685090 state 0x1 ref 1 00000100:00100000:0.0:1789760758.995101:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 363139685090 time 363108295941 state 0x0 ref 1 00000100:00100000:0.0:1789760758.995115:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ad66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+11:2351:x1876699863163264:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760758.995165:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 1048576, mtime: 0x6aad94f6, atime: 0x6aad94f6, ctime: 0x6aad94f6, blocks: 0x803 00010000:00010000:0.0:1789760758.995174:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aecf8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.995190:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=363s v=(0 0) 00010000:00010000:0.0:1789760758.995204:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760758.995226:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aecf8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.995240:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aecf8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760759.095759:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:1.0:1789760759.095768:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:1.0:1789760759.095782:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aecf8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760759.095796:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aecf8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760759.095830:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aecf8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760759.095838:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627d000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760759.095843:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aecf8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760759.095852:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aecf8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760759.095871:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aecf8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760759.095878:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aecf8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760759.095973:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ad66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+13:2351:x1876699863163264:12345-192.168.203.12@tcp:4:dd.500 Request processed in 100857us (102035us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1789760759.096000:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:1.0:1789760759.096009:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 363139685090 time 363108295941 state 0x2 ref 0 00000001:00080000:3.0:1789760759.096086:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967451 is committed 00000100:00100000:3.0:1789760759.105076:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760759.105168:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863163392 00000100:00100000:2.0:1789760759.105177:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863163392 00000100:00100000:2.0:1789760759.105241:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 363139685090 time 363108295941 state 0x0 ref 1 00000100:00100000:2.0:1789760759.105253:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 363308295941 time 363108295941 state 0x1 ref 1 00000100:00100000:2.0:1789760759.196066:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 363308295941 time 363309251995 state 0x0 ref 1 00000100:00100000:2.0:1789760759.196114:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14238df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+11:2351:x1876699863163392:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760759.196263:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 2097152, mtime: 0x6aad94f6, atime: 0x6aad94f6, ctime: 0x6aad94f6, blocks: 0x1007 00010000:00010000:2.0:1789760759.196274:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aecff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.196289:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=363s v=(0 0) 00010000:00010000:2.0:1789760759.196294:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760759.196300:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aecff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.196315:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aecff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760759.262273:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:2.0:1789760759.262282:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:2.0:1789760759.262294:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aecff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.262306:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aecff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.262315:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aecff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.262321:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760759.262336:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aecff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.262358:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aecff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.262378:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aecff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.262386:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aecff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760759.262483:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14238df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+13:2351:x1876699863163392:12345-192.168.203.12@tcp:4:dd.500 Request processed in 66379us (157411us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1789760759.262493:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:2.0:1789760759.262501:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 363308295941 time 363309251995 state 0x2 ref 0 00000001:00080000:1.0:1789760759.263214:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967452 is committed 00000100:00100000:2.0:1789760759.272647:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760759.273637:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863163520 00000100:00100000:3.0:1789760759.273649:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863163520 00000100:00100000:3.0:1789760759.273704:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 363308295941 time 363309251995 state 0x0 ref 1 00000100:00100000:3.0:1789760759.273717:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 363509251995 time 363309251995 state 0x1 ref 1 00000100:00100000:2.0:1789760759.397406:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 363509251995 time 363510591273 state 0x0 ref 1 00000100:00100000:2.0:1789760759.397432:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ac29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+11:2348:x1876699863163520:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760759.397496:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 3145728, mtime: 0x6aad94f6, atime: 0x6aad94f6, ctime: 0x6aad94f6, blocks: 0x1807 00010000:00010000:2.0:1789760759.397508:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aed06 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.397525:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=363s v=(0 0) 00010000:00010000:2.0:1789760759.397530:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760759.397538:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aed06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.397565:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aed06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760759.417681:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760759.417712:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760759.417735:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760759.417764:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760759.417794:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863163648 00000100:00100000:1.0:1789760759.417820:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863163648 00000100:00100000:1.0:1789760759.417869:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 281 00000100:00100000:1.0:1789760759.417879:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2350:x1876699863163648:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1789760759.417936:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2350:x1876699863163648:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 58us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760759.417944:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 281 00000100:00100000:1.0:1789760759.417977:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863163904 00000100:00100000:1.0:1789760759.417981:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863163904 00000100:00100000:1.0:1789760759.418016:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:1.0:1789760759.418023:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ad64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+41:2350:x1876699863163904:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1789760759.418051:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ad64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1da0113a-370d-4d79-883c-54efc174697f+41:2350:x1876699863163904:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 28us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760759.418057:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:1.0:1789760759.418074:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863163776 00000100:00100000:1.0:1789760759.418078:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863163776 00000100:00100000:1.0:1789760759.418104:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863164032 00000100:00100000:1.0:1789760759.418107:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863164032 00000100:00100000:1.0:1789760759.418145:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 173 00000100:00100000:1.0:1789760759.418152:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ad67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+36:2350:x1876699863163776:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1789760759.418182:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ad67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+36:2350:x1876699863163776:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 32us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760759.418188:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 173 00000100:00100000:1.0:1789760759.418212:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 174 00000100:00100000:1.0:1789760759.418219:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ad65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2350:x1876699863164032:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1789760759.418241:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ad65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2350:x1876699863164032:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760759.418247:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 174 00000100:00080000:1.0:1789760759.418269:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789760759.418285:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789760759.470113:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967342 is committed 00000001:00080000:2.0:1789760759.470145:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967343 is committed 00000001:00080000:2.0:1789760759.470172:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967344 is committed 00000001:00080000:0.0:1789760759.470536:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967453 is committed 00002000:00010000:0.0:1789760759.471062:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:0.0:1789760759.471067:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:0.0:1789760759.471082:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aed06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760759.471094:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aed06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760759.471103:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aed06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760759.471112:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760759.471116:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aed06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760759.471125:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aed06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760759.471143:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aed06 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760759.471168:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aed06 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760759.471310:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ac29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+11:2348:x1876699863163520:12345-192.168.203.12@tcp:4:dd.500 Request processed in 73882us (198668us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1789760759.471320:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:0.0:1789760759.471327:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 363509251995 time 363510591273 state 0x2 ref 0 00000100:00100000:0.0:1789760759.477227:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760759.477314:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863164160 00000100:00100000:3.0:1789760759.477324:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863164160 00000100:00100000:3.0:1789760759.477379:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 363509251995 time 363510591273 state 0x0 ref 1 00000100:00100000:3.0:1789760759.477392:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 363710591273 time 363510591273 state 0x1 ref 1 00000100:00100000:1.0:1789760759.597889:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 363710591273 time 363711073317 state 0x0 ref 1 00000100:00100000:1.0:1789760759.597924:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df244d0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+11:2351:x1876699863164160:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760759.597987:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 4194304, mtime: 0x6aad94f6, atime: 0x6aad94f6, ctime: 0x6aad94f6, blocks: 0x2007 00010000:00010000:1.0:1789760759.597996:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aed0d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760759.598012:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=363s v=(0 0) 00010000:00010000:1.0:1789760759.598016:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760759.598022:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aed0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760759.598035:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aed0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760759.653173:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967454 is committed 00002000:00010000:1.0:1789760759.653293:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:1.0:1789760759.653298:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:1.0:1789760759.653312:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aed0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760759.653326:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aed0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760759.653335:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aed0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760759.653342:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861f600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760759.653347:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aed0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760759.653357:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aed0d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760759.653375:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aed0d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760759.653382:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aed0d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760759.653485:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df244d0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+11:2351:x1876699863164160:12345-192.168.203.12@tcp:4:dd.500 Request processed in 55573us (176262us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1789760759.653507:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:1.0:1789760759.653515:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 363710591273 time 363711073317 state 0x2 ref 0 00000100:00100000:3.0:1789760759.659789:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760759.660013:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863164288 00000100:00100000:2.0:1789760759.660023:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863164288 00000100:00100000:2.0:1789760759.660077:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 363710591273 time 363711073317 state 0x0 ref 1 00000100:00100000:2.0:1789760759.660089:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 363911073317 time 363711073317 state 0x1 ref 1 00000100:00100000:2.0:1789760759.798101:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 363911073317 time 363911285867 state 0x0 ref 1 00000100:00100000:2.0:1789760759.798137:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14238e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+11:2348:x1876699863164288:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760759.798208:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 5242880, mtime: 0x6aad94f6, atime: 0x6aad94f6, ctime: 0x6aad94f6, blocks: 0x2807 00010000:00010000:2.0:1789760759.798218:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aed14 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.798234:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=363s v=(0 0) 00010000:00010000:2.0:1789760759.798239:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760759.798245:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aed14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.798259:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aed14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760759.891860:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967455 is committed 00002000:00010000:2.0:1789760759.892068:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:2.0:1789760759.892073:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789760758 -> 1789760759 00002000:00010000:2.0:1789760759.892076:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789760758 -> 1789760759 00002000:00010000:2.0:1789760759.892078:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:2.0:1789760759.892092:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aed14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.892105:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aed14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.892115:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aed14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.892122:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760759.892127:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aed14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.892136:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aed14 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.892156:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aed14 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760759.892163:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aed14 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760759.892285:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14238e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+11:2348:x1876699863164288:12345-192.168.203.12@tcp:4:dd.500 Request processed in 94163us (232501us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1789760759.892295:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:2.0:1789760759.892303:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 363911073317 time 363911285867 state 0x2 ref 0 00000100:00100000:3.0:1789760759.898492:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760759.899421:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863164416 00000100:00100000:2.0:1789760759.899431:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863164416 00000100:00100000:2.0:1789760759.899484:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 363911073317 time 363911285867 state 0x0 ref 1 00000100:00100000:2.0:1789760759.899498:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 364111285867 time 363911285867 state 0x1 ref 1 00000100:00100000:0.0:1789760759.998252:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 364111285867 time 364111437409 state 0x0 ref 1 00000100:00100000:0.0:1789760759.998289:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14238d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+11:2349:x1876699863164416:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760759.998349:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 6291456, mtime: 0x6aad94f7, atime: 0x6aad94f6, ctime: 0x6aad94f7, blocks: 0x3007 00010000:00010000:0.0:1789760759.998358:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce6a56ad/0x3e099f5ef04aed1b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760759.998375:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=364s v=(0 0) 00010000:00010000:0.0:1789760759.998379:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760759.998386:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce6a56ad/0x3e099f5ef04aed1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760759.998400:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce6a56ad/0x3e099f5ef04aed1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760760.014958:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789760760.069305:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:1.0:1789760760.069314:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:1.0:1789760760.069327:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce6a56ad/0x3e099f5ef04aed1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.069340:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce6a56ad/0x3e099f5ef04aed1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.069349:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce6a56ad/0x3e099f5ef04aed1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.069357:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627dc00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760760.069361:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce6a56ad/0x3e099f5ef04aed1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.069370:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce6a56ad/0x3e099f5ef04aed1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.069388:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce6a56ad/0x3e099f5ef04aed1b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.069396:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce6a56ad/0x3e099f5ef04aed1b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760760.069525:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14238d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+13:2349:x1876699863164416:12345-192.168.203.12@tcp:4:dd.500 Request processed in 71251us (171037us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1789760760.069535:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:1.0:1789760760.069542:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 364111285867 time 364111437409 state 0x2 ref 0 00000001:00080000:3.0:1789760760.073941:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967456 is committed 00000100:00100000:3.0:1789760760.075156:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760760.076038:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863164544 00000100:00100000:1.0:1789760760.076049:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863164544 00000100:00100000:0.0:1789760760.076240:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 364111285867 time 364111437409 state 0x0 ref 1 00000100:00100000:0.0:1789760760.076266:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 364311437409 time 364111437409 state 0x1 ref 1 00000100:00080000:1.0:1789760760.076387:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760760.198663:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 364311437409 time 364311847841 state 0x0 ref 1 00000100:00100000:1.0:1789760760.198698:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14238ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+11:2349:x1876699863164544:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760760.198772:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 7340032, mtime: 0x6aad94f7, atime: 0x6aad94f6, ctime: 0x6aad94f7, blocks: 0x3807 00010000:00010000:1.0:1789760760.198781:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aed22 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.198797:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=364s v=(0 0) 00010000:00010000:1.0:1789760760.198827:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760760.198834:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aed22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.198848:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aed22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760760.246308:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 7340032 -> 8388608 00002000:00010000:1.0:1789760760.246317:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1789760760.246330:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aed22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.246360:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aed22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.246370:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aed22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.246377:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861e800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760760.246382:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aed22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.246391:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aed22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.246494:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aed22 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.246503:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aed22 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760760.246597:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14238ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+13:2349:x1876699863164544:12345-192.168.203.12@tcp:4:dd.500 Request processed in 47912us (171443us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1789760760.246608:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:1.0:1789760760.246673:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 364311437409 time 364311847841 state 0x2 ref 0 00000001:00080000:3.0:1789760760.246708:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967457 is committed 00000100:00100000:2.0:1789760760.252703:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760760.252841:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863164672 00000100:00100000:3.0:1789760760.252850:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863164672 00000100:00100000:3.0:1789760760.252915:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 364311437409 time 364311847841 state 0x0 ref 1 00000100:00100000:3.0:1789760760.252926:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 364511847841 time 364311847841 state 0x1 ref 1 00000100:00100000:2.0:1789760760.398862:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 364511847841 time 364512046385 state 0x0 ref 1 00000100:00100000:2.0:1789760760.398893:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ac28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+11:2350:x1876699863164672:12345-192.168.203.12@tcp:4:dd.500 00000004:00080000:3.0:1789760760.398954:0:6760:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 364512149993ns, next at 365512146815ns, rc = 0 00002000:00010000:2.0:1789760760.398963:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 8388608, mtime: 0x6aad94f7, atime: 0x6aad94f6, ctime: 0x6aad94f7, blocks: 0x4007 00010000:00010000:2.0:1789760760.398974:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a6c5da4/0x3e099f5ef04aed29 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760760.398980:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14238c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883057408:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789760760.398993:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=364s v=(0 0) 00010000:00010000:2.0:1789760760.398999:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760760.399005:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a6c5da4/0x3e099f5ef04aed29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.399019:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a6c5da4/0x3e099f5ef04aed29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760760.399052:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760760.399171:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883057408 00000100:00100000:3.0:1789760760.399179:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883057408 00000100:00100000:3.0:1789760760.399246:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789760760.399253:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df244d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883057408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760760.399266:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 88539136 pending 1703936 free 3836739584 avail 3832545280 00000100:00100000:3.0:1789760760.399317:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df244d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883057408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760760.399324:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789760760.399369:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14238c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883057408:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789760760.399835:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789760760.469269:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967458 is committed 00002000:00010000:1.0:1789760760.469599:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 8388608 -> 9437184 00002000:00010000:1.0:1789760760.469605:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 16391 -> 18439 00010000:00010000:1.0:1789760760.469632:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a6c5da4/0x3e099f5ef04aed29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.469644:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a6c5da4/0x3e099f5ef04aed29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.469653:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a6c5da4/0x3e099f5ef04aed29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.469660:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760760.469665:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a6c5da4/0x3e099f5ef04aed29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.469674:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a6c5da4/0x3e099f5ef04aed29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.469694:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a6c5da4/0x3e099f5ef04aed29 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.469702:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a6c5da4/0x3e099f5ef04aed29 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760760.469988:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ac28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+11:2350:x1876699863164672:12345-192.168.203.12@tcp:4:dd.500 Request processed in 71103us (217287us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1789760760.469999:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:1.0:1789760760.470007:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 364511847841 time 364512046385 state 0x2 ref 0 00000100:00100000:0.0:1789760760.479343:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760760.479435:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863164800 00000100:00100000:3.0:1789760760.479447:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863164800 00000100:00100000:3.0:1789760760.479502:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 364511847841 time 364512046385 state 0x0 ref 1 00000100:00100000:3.0:1789760760.479515:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 364712046385 time 364512046385 state 0x1 ref 1 00000001:00080000:0.0:1789760760.482206:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967406 is committed 00000004:00080000:0.0:1789760760.482230:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:0.0:1789760760.482248:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000100:00100000:1.0:1789760760.482586:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14ad66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883057536:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789760760.482670:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760760.482748:0:12459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883057536 00000100:00100000:1.0:1789760760.482755:0:12459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883057536 00000100:00100000:1.0:1789760760.482826:0:12459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789760760.482836:0:12459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ad65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883057536:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789760760.482862:0:12459:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:1.0:1789760760.482895:0:12459:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 8388608, mtime: 0x6aad94f3, atime: 0x6aad94f1, ctime: 0x6aad94f3, blocks: 0x4007 00010000:00010000:1.0:1789760760.482903:0:12459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aed30 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.482920:0:12459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=364s v=(0 0) 00010000:00010000:1.0:1789760760.482925:0:12459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760760.482931:0:12459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aed30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.482949:0:12459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aed30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.482959:0:12459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aed30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.482967:0:12459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aed30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.482986:0:12459:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789760760.483708:0:12459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ad65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3310:x1876699883057536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 871us (1035us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1789760760.483726:0:12459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:1.0:1789760760.483753:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789760760.483766:0:7646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789760760.483772:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aed30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.483781:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861e800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760760.483784:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aed30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.483794:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aed30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.483832:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aed30 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.483840:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aed30 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.483857:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760760.483860:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760760.483861:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789760760.483894:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df14ad66680/2, rc 0, transno 4294967345 00000100:00100000:1.0:1789760760.483905:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14ad66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883057536:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789760760.484018:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df244d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883057664:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789760760.484053:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760760.484088:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883057664 00000100:00100000:0.0:1789760760.484093:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883057664 00000100:00100000:0.0:1789760760.484124:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789760760.484131:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df244d0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883057664:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789760760.484150:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:0.0:1789760760.484166:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aed37 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.484198:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea5f19f5/0x3e099f5ef04aeae4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2e5 expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.484209:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aeb2a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d301 expref: 11 pid: 12460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.484217:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000018197af4/0x3e099f5ef04aeb23 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2fa expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.484334:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043f45fa3/0x3e099f5ef04aeb1c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2de expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.484343:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000099791bdf/0x3e099f5ef04aeb15 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2ec expref: 11 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.484359:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aeaeb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2f3 expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.484367:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1789760760.484370:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760760.484375:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aed37 lrc: 9/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.484480:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aeaeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2f3 expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.484495:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aeaeb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2f3 expref: 11 pid: 6693 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760760.484507:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df259bd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1876699883057792:192.168.203.12@tcp:104: 00010000:00010000:0.0:1789760760.484576:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000099791bdf/0x3e099f5ef04aeb15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2ec expref: 11 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.484598:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000099791bdf/0x3e099f5ef04aeb15 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2ec expref: 11 pid: 6695 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760760.484609:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df259bd7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1876699883057920:192.168.203.12@tcp:104: 00010000:00010000:0.0:1789760760.484642:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000043f45fa3/0x3e099f5ef04aeb1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2de expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.484652:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000043f45fa3/0x3e099f5ef04aeb1c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2de expref: 11 pid: 6693 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760760.484661:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df259bd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1876699883058048:192.168.203.12@tcp:104: 00010000:00010000:0.0:1789760760.484691:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000018197af4/0x3e099f5ef04aeb23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2fa expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.484701:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000018197af4/0x3e099f5ef04aeb23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2fa expref: 11 pid: 6693 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760760.484710:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df259bd4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1876699883058176:192.168.203.12@tcp:104: 00010000:00010000:0.0:1789760760.484740:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aeb2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d301 expref: 11 pid: 12460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.484749:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aeb2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d301 expref: 11 pid: 12460 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760760.484772:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df259bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1876699883058304:192.168.203.12@tcp:104: 00010000:00010000:0.0:1789760760.484827:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ea5f19f5/0x3e099f5ef04aeae4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2e5 expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.484838:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ea5f19f5/0x3e099f5ef04aeae4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2e5 expref: 11 pid: 6693 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760760.484847:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df259bd4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1876699883058432:192.168.203.12@tcp:104: 00000100:00100000:0.0:1789760760.484871:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df259abf540 going to sleep for 11 seconds 00000001:00080000:0.0:1789760760.486951:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967408 is committed 00000004:00080000:0.0:1789760760.486986:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:0.0:1789760760.488561:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df259bd7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1876699883057920:192.168.203.12@tcp:104: 00000100:00100000:2.0:1789760760.489252:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760760.489569:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789760760.489589:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14ad66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883058560:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789760760.489669:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760760.489713:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883058560 00000100:00100000:1.0:1789760760.489720:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883058560 00000100:00100000:1.0:1789760760.489763:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789760760.489772:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ad64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1876699883058560:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789760760.489799:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6 count 1 00002000:00010000:1.0:1789760760.489850:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 8388608, mtime: 0x6aad94f3, atime: 0x6aad94f1, ctime: 0x6aad94f3, blocks: 0x4007 00010000:00010000:1.0:1789760760.489859:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed3e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.489874:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=364s v=(0 0) 00010000:00010000:1.0:1789760760.489879:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760760.489884:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.489897:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.489907:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.489914:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.489932:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789760760.490537:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ad64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3309:x1876699883058560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 764us (866us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1789760760.490552:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00010000:1.0:1789760760.490579:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789760760.490585:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.490594:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861e400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760760.490598:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.490607:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.490624:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed3e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.490631:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed3e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.490647:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760760.490649:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760760.490651:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789760760.490674:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df14ad66d80/2, rc 0, transno 4294967459 00000100:00100000:1.0:1789760760.490679:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14ad66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883058560:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789760760.491202:0:7645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863164928 00000100:00100000:3.0:1789760760.491209:0:7645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863164928 00010000:00010000:3.0:1789760760.491245:0:7645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000099791bdf/0x3e099f5ef04aeb15 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2ec expref: 12 pid: 6695 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760760.491275:0:7645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:3.0:1789760760.491283:0:7645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ac2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1da0113a-370d-4d79-883c-54efc174697f+12:2348:x1876699863164928:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789760760.491295:0:7645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760760.491301:0:7645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000099791bdf/0x3e099f5ef04aeb15 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2ec expref: 12 pid: 6695 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760760.491312:0:7645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000099791bdf/0x3e099f5ef04aeb15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2ec expref: 12 pid: 6695 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760760.491336:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099791bdf/0x3e099f5ef04aeb15 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2ec expref: 12 pid: 6695 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760760.491349:0:7645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760760.491393:0:7645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ac2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1da0113a-370d-4d79-883c-54efc174697f+11:2348:x1876699863164928:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 110us (3776us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760760.491400:0:7645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:0.0:1789760760.491624:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760760.491650:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760760.491681:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760760.491696:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760760.491712:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760760.491727:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863165184 00000100:00100000:0.0:1789760760.491731:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863165184 00010000:00010000:0.0:1789760760.491749:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000018197af4/0x3e099f5ef04aeb23 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2fa expref: 11 pid: 6693 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760760.491764:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863165056 00000100:00100000:0.0:1789760760.491767:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863165056 00010000:00010000:0.0:1789760760.491786:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000043f45fa3/0x3e099f5ef04aeb1c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2de expref: 12 pid: 6693 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760760.491833:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863165568 00000100:00100000:0.0:1789760760.491837:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863165568 00010000:00010000:0.0:1789760760.491849:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ea5f19f5/0x3e099f5ef04aeae4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2e5 expref: 13 pid: 6693 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760760.491861:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863165440 00000100:00100000:0.0:1789760760.491863:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863165440 00010000:00010000:0.0:1789760760.491873:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aeb2a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d301 expref: 14 pid: 12460 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760760.491888:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863165312 00000100:00100000:0.0:1789760760.491891:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863165312 00010000:00010000:0.0:1789760760.491901:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aeaeb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2f3 expref: 15 pid: 6693 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760760.491914:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:0.0:1789760760.491920:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df260392450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1da0113a-370d-4d79-883c-54efc174697f+15:2350:x1876699863165184:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789760760.491928:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760760.491932:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000018197af4/0x3e099f5ef04aeb23 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2fa expref: 15 pid: 6693 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.491940:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000018197af4/0x3e099f5ef04aeb23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2fa expref: 15 pid: 6693 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.491953:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760760.491985:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df260392450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1da0113a-370d-4d79-883c-54efc174697f+15:2350:x1876699863165184:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 64us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760760.491992:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:0.0:1789760760.492035:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:0.0:1789760760.492042:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1da0113a-370d-4d79-883c-54efc174697f+14:2350:x1876699863165056:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789760760.492049:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760760.492054:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000043f45fa3/0x3e099f5ef04aeb1c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2de expref: 14 pid: 6693 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.492063:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000043f45fa3/0x3e099f5ef04aeb1c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2de expref: 14 pid: 6693 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.492075:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760760.492092:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1da0113a-370d-4d79-883c-54efc174697f+14:2350:x1876699863165056:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 51us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760760.492098:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:0.0:1789760760.492110:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:0.0:1789760760.492115:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1da0113a-370d-4d79-883c-54efc174697f+13:2349:x1876699863165568:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789760760.492122:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760760.492126:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ea5f19f5/0x3e099f5ef04aeae4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2e5 expref: 13 pid: 6693 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.492135:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ea5f19f5/0x3e099f5ef04aeae4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2e5 expref: 13 pid: 6693 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.492146:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760760.492170:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1da0113a-370d-4d79-883c-54efc174697f+13:2349:x1876699863165568:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 55us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760760.492177:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:0.0:1789760760.492201:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:0.0:1789760760.492208:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1da0113a-370d-4d79-883c-54efc174697f+12:2349:x1876699863165440:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789760760.492215:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760760.492220:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aeb2a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d301 expref: 12 pid: 12460 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.492229:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aeb2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d301 expref: 12 pid: 12460 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.492241:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760760.492259:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1da0113a-370d-4d79-883c-54efc174697f+12:2349:x1876699863165440:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 52us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760760.492265:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:0.0:1789760760.492277:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:0.0:1789760760.492283:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1da0113a-370d-4d79-883c-54efc174697f+11:2350:x1876699863165312:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789760760.492289:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760760.492294:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aeaeb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2f3 expref: 11 pid: 6693 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.492303:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aeaeb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2f3 expref: 11 pid: 6693 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.492315:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760760.492325:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760760.492330:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aed37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.492341:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aed37 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760760.492361:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760760.492380:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1da0113a-370d-4d79-883c-54efc174697f+11:2350:x1876699863165312:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 97us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760760.492386:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 58 00010000:00010000:3.0:1789760760.496563:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aeaeb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2f3 expref: 10 pid: 6693 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760760.496591:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df259bd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1876699883057792:192.168.203.12@tcp:104: 00010000:00010000:3.0:1789760760.496605:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043f45fa3/0x3e099f5ef04aeb1c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2de expref: 9 pid: 6693 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760760.496638:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df259bd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1876699883058048:192.168.203.12@tcp:104: 00010000:00010000:3.0:1789760760.496653:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018197af4/0x3e099f5ef04aeb23 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2fa expref: 8 pid: 6693 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760760.496663:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df259bd4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1876699883058176:192.168.203.12@tcp:104: 00010000:00010000:3.0:1789760760.496675:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aeb2a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d301 expref: 7 pid: 12460 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760760.496684:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df259bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1876699883058304:192.168.203.12@tcp:104: 00010000:00010000:3.0:1789760760.496695:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea5f19f5/0x3e099f5ef04aeae4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d2e5 expref: 6 pid: 6693 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760760.496705:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df259bd4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1876699883058432:192.168.203.12@tcp:104: 00010000:00010000:3.0:1789760760.496738:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aed37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760760.496750:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aed37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760760.496757:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aed37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760760.496779:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aed37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760760.496787:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aed37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760760.496832:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789760760.497538:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df244d0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1876699883057664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13405us (13482us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1789760760.497548:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00010000:2.0:1789760760.497845:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789760760.497853:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aed37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.497863:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627cc00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760760.497868:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aed37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.497878:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aed37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760760.497899:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aed37 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789760760.497907:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df244d0f100/2, rc 0, transno 4294967460 00010000:00010000:2.0:1789760760.497908:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aed37 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760760.497917:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df244d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883057664:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789760760.497934:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760760.497938:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760760.497939:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760760.600058:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 364712046385 time 364713243127 state 0x0 ref 1 00000100:00100000:1.0:1789760760.600107:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df244d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863164800:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760760.600169:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 9437184, mtime: 0x6aad94f7, atime: 0x6aad94f6, ctime: 0x6aad94f7, blocks: 0x4807 00010000:00010000:1.0:1789760760.600178:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed45 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.600203:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=364s v=(0 0) 00010000:00010000:1.0:1789760760.600208:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760760.600214:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.600229:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760760.676910:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967461 is committed 00000001:00080000:3.0:1789760760.676928:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967459 is committed 00000001:00080000:3.0:1789760760.676934:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967460 is committed 00002000:00010000:1.0:1789760760.677034:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 9437184 -> 10485760 00002000:00010000:1.0:1789760760.677040:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 18439 -> 20487 00010000:00010000:1.0:1789760760.677055:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.677066:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.677075:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.677081:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861e400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760760.677086:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.677110:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.677130:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed45 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.677137:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed45 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760760.677247:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df244d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863164800:12345-192.168.203.12@tcp:4:dd.500 Request processed in 77149us (197909us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1789760760.677257:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:1.0:1789760760.677265:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 364712046385 time 364713243127 state 0x2 ref 0 00000100:00100000:0.0:1789760760.682565:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760760.684151:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863165696 00000100:00100000:2.0:1789760760.684165:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863165696 00000100:00100000:2.0:1789760760.684242:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 364712046385 time 364713243127 state 0x0 ref 1 00000100:00100000:2.0:1789760760.684255:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 364913243127 time 364713243127 state 0x1 ref 1 00000100:00100000:1.0:1789760760.800258:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 364913243127 time 364913442939 state 0x0 ref 1 00000100:00100000:1.0:1789760760.800294:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863165696:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760760.800358:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 10485760, mtime: 0x6aad94f7, atime: 0x6aad94f6, ctime: 0x6aad94f7, blocks: 0x5007 00010000:00010000:1.0:1789760760.800368:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed4c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.800387:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=364s v=(0 0) 00010000:00010000:1.0:1789760760.800392:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760760.800398:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.800436:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760760.856762:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967462 is committed 00002000:00010000:1.0:1789760760.856869:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 10485760 -> 11534336 00002000:00010000:1.0:1789760760.856874:0:11799:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789760759 -> 1789760760 00002000:00010000:1.0:1789760760.856877:0:11799:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789760759 -> 1789760760 00002000:00010000:1.0:1789760760.856879:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 20487 -> 22535 00010000:00010000:1.0:1789760760.856892:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.856904:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.856913:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.856920:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861e400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760760.856924:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.856933:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed4c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.856950:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed4c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760760.856976:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed4c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760760.857066:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863165696:12345-192.168.203.12@tcp:4:dd.500 Request processed in 56786us (174507us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1789760760.857075:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:1.0:1789760760.857083:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 364913243127 time 364913442939 state 0x2 ref 0 00000100:00100000:2.0:1789760760.865544:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760760.865665:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863165824 00000100:00100000:3.0:1789760760.865673:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863165824 00000100:00100000:3.0:1789760760.865727:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 364913243127 time 364913442939 state 0x0 ref 1 00000100:00100000:3.0:1789760760.865740:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 365113442939 time 364913442939 state 0x1 ref 1 00000100:00100000:1.0:1789760761.000471:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 365113442939 time 365113656296 state 0x0 ref 1 00000100:00100000:1.0:1789760761.000503:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ac28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863165824:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760761.000560:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 11534336, mtime: 0x6aad94f8, atime: 0x6aad94f6, ctime: 0x6aad94f8, blocks: 0x5807 00010000:00010000:1.0:1789760761.000570:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed53 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760761.000586:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=365s v=(0 0) 00010000:00010000:1.0:1789760761.000591:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760761.000597:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760761.000613:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760761.040186:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789760761.068746:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967463 is committed 00002000:00010000:3.0:1789760761.069135:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 11534336 -> 12582912 00002000:00010000:3.0:1789760761.069141:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 22535 -> 24583 00010000:00010000:3.0:1789760761.069218:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.069232:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.069256:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.069263:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861e400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760761.069268:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.069276:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.069295:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed53 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.069303:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aed53 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760761.069443:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ac28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863165824:12345-192.168.203.12@tcp:4:dd.500 Request processed in 68951us (203904us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1789760761.069454:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:3.0:1789760761.069461:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 365113442939 time 365113656296 state 0x2 ref 0 00000100:00100000:2.0:1789760761.077923:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760761.078091:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863165952 00000100:00100000:3.0:1789760761.078100:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863165952 00000100:00100000:3.0:1789760761.078152:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 365113442939 time 365113656296 state 0x0 ref 1 00000100:00100000:3.0:1789760761.078256:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 365313656296 time 365113656296 state 0x1 ref 1 00000100:00100000:1.0:1789760761.200621:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 365313656296 time 365313806066 state 0x0 ref 1 00000100:00100000:1.0:1789760761.200668:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ac28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863165952:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760761.200727:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 12582912, mtime: 0x6aad94f8, atime: 0x6aad94f6, ctime: 0x6aad94f8, blocks: 0x6007 00010000:00010000:1.0:1789760761.200735:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aed5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760761.200749:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=365s v=(0 0) 00010000:00010000:1.0:1789760761.200754:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760761.200760:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aed5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760761.200771:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aed5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760761.291843:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967464 is committed 00002000:00010000:0.0:1789760761.291909:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 12582912 -> 13631488 00002000:00010000:0.0:1789760761.291914:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 24583 -> 26631 00010000:00010000:0.0:1789760761.291928:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aed5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760761.292088:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aed5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760761.292098:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aed5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760761.292106:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861e800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760761.292111:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aed5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760761.292140:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aed5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760761.292161:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aed5a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760761.292170:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aed5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760761.292281:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ac28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863165952:12345-192.168.203.12@tcp:4:dd.500 Request processed in 91622us (214362us total) trans 4294967464 rc 0/0 00000100:00100000:0.0:1789760761.292292:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:0.0:1789760761.292299:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 365313656296 time 365313806066 state 0x2 ref 0 00000100:00100000:2.0:1789760761.306428:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760761.306531:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863166080 00000100:00100000:0.0:1789760761.306541:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863166080 00000100:00100000:0.0:1789760761.306591:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 365313656296 time 365313806066 state 0x0 ref 1 00000100:00100000:0.0:1789760761.306604:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 365513806066 time 365313806066 state 0x1 ref 1 00000100:00100000:1.0:1789760761.401363:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 365513806066 time 365514549273 state 0x0 ref 1 00000100:00100000:1.0:1789760761.401397:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ac2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863166080:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760761.401454:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 13631488, mtime: 0x6aad94f8, atime: 0x6aad94f6, ctime: 0x6aad94f8, blocks: 0x6807 00010000:00010000:1.0:1789760761.401463:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000278bde42/0x3e099f5ef04aed61 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760761.401479:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=365s v=(0 0) 00010000:00010000:1.0:1789760761.401484:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760761.401490:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000278bde42/0x3e099f5ef04aed61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760761.401523:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000278bde42/0x3e099f5ef04aed61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760761.470328:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967465 is committed 00002000:00010000:0.0:1789760761.470404:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 13631488 -> 14680064 00002000:00010000:0.0:1789760761.470409:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 26631 -> 28679 00010000:00010000:0.0:1789760761.470423:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000278bde42/0x3e099f5ef04aed61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760761.470435:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000278bde42/0x3e099f5ef04aed61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760761.470456:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000278bde42/0x3e099f5ef04aed61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760761.470463:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861fa00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760761.470467:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000278bde42/0x3e099f5ef04aed61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760761.470477:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000278bde42/0x3e099f5ef04aed61 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760761.470496:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000278bde42/0x3e099f5ef04aed61 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760761.470504:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000278bde42/0x3e099f5ef04aed61 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760761.470601:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ac2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863166080:12345-192.168.203.12@tcp:4:dd.500 Request processed in 69216us (164179us total) trans 4294967465 rc 0/0 00000100:00100000:0.0:1789760761.470715:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:0.0:1789760761.470723:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 365513806066 time 365514549273 state 0x2 ref 0 00000100:00100000:0.0:1789760761.479861:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760761.479896:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863166208 00000100:00100000:2.0:1789760761.479918:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863166208 00000100:00100000:2.0:1789760761.479976:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 365513806066 time 365514549273 state 0x0 ref 1 00000100:00100000:2.0:1789760761.479990:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 365714549273 time 365514549273 state 0x1 ref 1 00000100:00100000:3.0:1789760761.603164:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 365714549273 time 365716350582 state 0x0 ref 1 00000100:00100000:3.0:1789760761.603207:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863166208:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760761.603267:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 14680064, mtime: 0x6aad94f8, atime: 0x6aad94f6, ctime: 0x6aad94f8, blocks: 0x7007 00010000:00010000:3.0:1789760761.603275:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8034bc6/0x3e099f5ef04aed68 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.603292:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=365s v=(0 0) 00010000:00010000:3.0:1789760761.603296:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760761.603302:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8034bc6/0x3e099f5ef04aed68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760761.603316:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8034bc6/0x3e099f5ef04aed68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760761.671901:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 14680064 -> 15728640 00002000:00010000:1.0:1789760761.671910:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 28679 -> 30727 00010000:00010000:1.0:1789760761.671925:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8034bc6/0x3e099f5ef04aed68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760761.671940:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8034bc6/0x3e099f5ef04aed68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760761.671949:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8034bc6/0x3e099f5ef04aed68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760761.671955:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c4800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760761.671960:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8034bc6/0x3e099f5ef04aed68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760761.671969:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8034bc6/0x3e099f5ef04aed68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760761.671987:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8034bc6/0x3e099f5ef04aed68 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760761.671994:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8034bc6/0x3e099f5ef04aed68 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760761.672115:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+7:2349:x1876699863166208:12345-192.168.203.12@tcp:4:dd.500 Request processed in 68921us (192259us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1789760761.672126:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:1.0:1789760761.672134:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 365714549273 time 365716350582 state 0x2 ref 0 00000001:00080000:2.0:1789760761.672706:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967466 is committed 00000100:00100000:2.0:1789760761.677559:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760761.677732:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863166336 00000100:00100000:0.0:1789760761.677741:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863166336 00000100:00100000:0.0:1789760761.677963:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 365714549273 time 365716350582 state 0x0 ref 1 00000100:00100000:0.0:1789760761.677990:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 365916350582 time 365716350582 state 0x1 ref 1 00000100:00100000:0.0:1789760761.804372:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 365916350582 time 365917556658 state 0x0 ref 1 00000100:00100000:0.0:1789760761.804406:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ac28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863166336:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760761.804466:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 15728640, mtime: 0x6aad94f8, atime: 0x6aad94f6, ctime: 0x6aad94f8, blocks: 0x7807 00010000:00010000:0.0:1789760761.804475:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000996d94d0/0x3e099f5ef04aed6f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760761.804490:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=365s v=(0 0) 00010000:00010000:0.0:1789760761.804494:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760761.804500:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000996d94d0/0x3e099f5ef04aed6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760761.804513:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000996d94d0/0x3e099f5ef04aed6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760761.870056:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967467 is committed 00002000:00010000:0.0:1789760761.870273:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 15728640 -> 16777216 00002000:00010000:0.0:1789760761.870277:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789760760 -> 1789760761 00002000:00010000:0.0:1789760761.870351:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789760760 -> 1789760761 00002000:00010000:0.0:1789760761.870353:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 30727 -> 32775 00010000:00010000:0.0:1789760761.870368:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000996d94d0/0x3e099f5ef04aed6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760761.870382:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000996d94d0/0x3e099f5ef04aed6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760761.870490:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000996d94d0/0x3e099f5ef04aed6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760761.870499:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627d800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760761.870504:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000996d94d0/0x3e099f5ef04aed6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760761.870514:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000996d94d0/0x3e099f5ef04aed6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760761.870535:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000996d94d0/0x3e099f5ef04aed6f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760761.870543:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000996d94d0/0x3e099f5ef04aed6f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760761.870644:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ac28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863166336:12345-192.168.203.12@tcp:4:dd.500 Request processed in 66249us (193089us total) trans 4294967467 rc 0/0 00000100:00100000:0.0:1789760761.870655:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:0.0:1789760761.870664:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 365916350582 time 365917556658 state 0x2 ref 0 00000100:00100000:2.0:1789760761.880000:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760761.880499:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863166464 00000100:00100000:0.0:1789760761.880509:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863166464 00000100:00100000:0.0:1789760761.885945:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 365916350582 time 365917556658 state 0x0 ref 1 00000100:00100000:0.0:1789760761.885961:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 366117556658 time 365917556658 state 0x1 ref 1 00000100:00100000:1.0:1789760761.936166:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14238c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e2780560-8e82-4256-94b0-2e524f3bed06:3309:1876699883058688:0@lo:400:kworker.0 00000100:00100000:1.0:1789760761.936249:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760761.936304:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14238dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1876699883059200:0@lo:400:kworker.0 00000100:00100000:1.0:1789760761.936329:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760761.936361:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789760761.936367:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14238e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883059072:0@lo:400:kworker.0 00000100:00100000:1.0:1789760761.936393:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760761.936415:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14238fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1876699883058944:0@lo:400:kworker.0 00000100:00100000:1.0:1789760761.936434:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760761.936449:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789760761.936454:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14238f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883058816:0@lo:400:kworker.0 00000100:00100000:1.0:1789760761.936473:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760761.936488:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14238d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883059328:0@lo:400:kworker.0 00000100:00100000:1.0:1789760761.936509:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760761.936534:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883059200 00000100:00100000:1.0:1789760761.936541:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883059200 00000100:00100000:1.0:1789760761.936585:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883058944 00000100:00100000:1.0:1789760761.936588:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883058944 00000100:00100000:1.0:1789760761.936600:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883058816 00000100:00100000:1.0:1789760761.936602:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883058816 00000100:00100000:1.0:1789760761.936642:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789760761.936649:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ad67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876699883059200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760761.936696:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ad67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876699883059200:12345-0@lo:400:kworker.0 Request processed in 46us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760761.936702:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789760761.936719:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789760761.936725:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ad67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876699883058944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760761.936755:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ad67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876699883058944:12345-0@lo:400:kworker.0 Request processed in 31us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760761.936761:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789760761.936771:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789760761.936776:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ad66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883058816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760761.936797:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ad66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883058816:12345-0@lo:400:kworker.0 Request processed in 21us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760761.936828:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789760761.936844:0:12459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883059072 00000100:00100000:1.0:1789760761.936847:0:12459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883059072 00000100:00100000:1.0:1789760761.936870:0:12459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883059328 00000100:00100000:1.0:1789760761.936873:0:12459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883059328 00000100:00100000:1.0:1789760761.936888:0:12459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789760761.936894:0:12459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d063850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883059072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760761.936921:0:12459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d063850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883059072:12345-0@lo:400:kworker.0 Request processed in 27us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760761.936926:0:12459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789760761.937047:0:12459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789760761.937053:0:12459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ad65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3311:x1876699883059328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760761.937089:0:12459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ad65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3311:x1876699883059328:12345-0@lo:400:kworker.0 Request processed in 37us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760761.937095:0:12459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1789760761.937117:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760761.937153:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14238f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883058816:0@lo:400:kworker.0 00000100:00100000:1.0:1789760761.937164:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14238d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883059328:0@lo:400:kworker.0 00000100:00100000:1.0:1789760761.937172:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14238fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1876699883058944:0@lo:400:kworker.0 00000100:00100000:1.0:1789760761.937211:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967460 gen 2 00000004:00080000:1.0:1789760761.937215:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df14ad66d80, transno 4294967459 00000004:00080000:1.0:1789760761.937223:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df244d0f100, transno 4294967460 00000100:00100000:1.0:1789760761.937227:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14238e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883059072:0@lo:400:kworker.0 00000100:00100000:1.0:1789760761.937237:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14238dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1876699883059200:0@lo:400:kworker.0 00000100:00100000:3.0:1789760761.938258:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883058688 00000100:00100000:3.0:1789760761.938266:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883058688 00000100:00100000:3.0:1789760761.938303:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789760761.938310:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3309:x1876699883058688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760761.938380:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3309:x1876699883058688:12345-0@lo:400:kworker.0 Request processed in 70us (2130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760761.938387:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1789760761.938473:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14238c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e2780560-8e82-4256-94b0-2e524f3bed06:3309:1876699883058688:0@lo:400:kworker.0 00000100:00100000:1.0:1789760762.004623:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 366117556658 time 366117806749 state 0x0 ref 1 00000100:00100000:1.0:1789760762.004674:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ac2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863166464:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760762.004735:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 16777216, mtime: 0x6aad94f9, atime: 0x6aad94f6, ctime: 0x6aad94f9, blocks: 0x8007 00010000:00010000:1.0:1789760762.004744:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5683f9e/0x3e099f5ef04aed76 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760762.004761:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=366s v=(0 0) 00010000:00010000:1.0:1789760762.004765:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760762.004772:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5683f9e/0x3e099f5ef04aed76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789760762.004896:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789760762.004938:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5683f9e/0x3e099f5ef04aed76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760762.064375:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789760762.065346:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967468 is committed 00002000:00010000:0.0:1789760762.065370:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 16777216 -> 17825792 00002000:00010000:0.0:1789760762.065375:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 32775 -> 34823 00010000:00010000:0.0:1789760762.065390:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5683f9e/0x3e099f5ef04aed76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760762.065402:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5683f9e/0x3e099f5ef04aed76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760762.065411:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5683f9e/0x3e099f5ef04aed76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760762.065419:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861e200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760762.065423:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5683f9e/0x3e099f5ef04aed76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760762.065433:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5683f9e/0x3e099f5ef04aed76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760762.065453:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5683f9e/0x3e099f5ef04aed76 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760762.065460:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5683f9e/0x3e099f5ef04aed76 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760762.065640:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ac2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863166464:12345-192.168.203.12@tcp:4:dd.500 Request processed in 60923us (185573us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1789760762.065667:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:0.0:1789760762.065675:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 366117556658 time 366117806749 state 0x2 ref 0 00000100:00100000:2.0:1789760762.076231:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760762.078073:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863166592 00000100:00100000:3.0:1789760762.078088:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863166592 00000100:00100000:3.0:1789760762.078150:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 366117556658 time 366117806749 state 0x0 ref 1 00000100:00100000:3.0:1789760762.078192:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 366317806749 time 366117806749 state 0x1 ref 1 00000100:00100000:1.0:1789760762.204798:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 366317806749 time 366317981585 state 0x0 ref 1 00000100:00100000:1.0:1789760762.204911:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ac29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863166592:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760762.204969:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 17825792, mtime: 0x6aad94f9, atime: 0x6aad94f6, ctime: 0x6aad94f9, blocks: 0x8807 00010000:00010000:1.0:1789760762.204978:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077188a43/0x3e099f5ef04aed7d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760762.204995:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=366s v=(0 0) 00010000:00010000:1.0:1789760762.205000:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760762.205006:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077188a43/0x3e099f5ef04aed7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760762.205020:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077188a43/0x3e099f5ef04aed7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760762.292938:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 17825792 -> 18874368 00002000:00010000:1.0:1789760762.292947:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 34823 -> 36871 00010000:00010000:1.0:1789760762.292962:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077188a43/0x3e099f5ef04aed7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760762.292973:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077188a43/0x3e099f5ef04aed7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760762.293000:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077188a43/0x3e099f5ef04aed7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760762.293008:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861ec00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760762.293013:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077188a43/0x3e099f5ef04aed7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760762.293021:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077188a43/0x3e099f5ef04aed7d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760762.293042:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077188a43/0x3e099f5ef04aed7d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760762.293049:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077188a43/0x3e099f5ef04aed7d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760762.293131:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ac29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+7:2349:x1876699863166592:12345-192.168.203.12@tcp:4:dd.500 Request processed in 88282us (216904us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1789760762.293141:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:1.0:1789760762.293148:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 366317806749 time 366317981585 state 0x2 ref 0 00000001:00080000:2.0:1789760762.293357:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967469 is committed 00000100:00100000:2.0:1789760762.306869:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760762.306952:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863166720 00000100:00100000:3.0:1789760762.306962:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863166720 00000100:00100000:3.0:1789760762.307012:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 366317806749 time 366317981585 state 0x0 ref 1 00000100:00100000:3.0:1789760762.307025:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 366517981585 time 366317981585 state 0x1 ref 1 00000100:00100000:0.0:1789760762.404952:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 366517981585 time 366518137399 state 0x0 ref 1 00000100:00100000:0.0:1789760762.404984:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ac29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863166720:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760762.405044:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 18874368, mtime: 0x6aad94f9, atime: 0x6aad94f6, ctime: 0x6aad94f9, blocks: 0x9007 00010000:00010000:0.0:1789760762.405053:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aed84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760762.405070:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=366s v=(0 0) 00010000:00010000:0.0:1789760762.405074:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760762.405080:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aed84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760762.405094:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aed84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789760762.448140:0:7838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 366561334306ns, next at 367561330996ns, rc = 0 00000100:00100000:1.0:1789760762.448255:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df259bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883059456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760762.448335:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760762.448466:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883059456 00000100:00100000:0.0:1789760762.448475:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883059456 00000100:00100000:0.0:1789760762.448539:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789760762.448548:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ad66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876699883059456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789760762.448583:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 71499776 pending 0 free 3843031040 avail 3840933888 00000100:00100000:0.0:1789760762.448631:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ad66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876699883059456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760762.448666:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789760762.448732:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df259bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883059456:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789760762.449785:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1789760762.525775:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967470 is committed 00002000:00010000:0.0:1789760762.525892:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 18874368 -> 19922944 00002000:00010000:0.0:1789760762.525898:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 36871 -> 38921 00010000:00010000:0.0:1789760762.525913:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aed84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760762.525927:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aed84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760762.525936:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aed84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760762.525943:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627d400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760762.525948:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aed84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760762.525958:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aed84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760762.525978:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aed84 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760762.525986:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aed84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760762.526189:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ac29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863166720:12345-192.168.203.12@tcp:4:dd.500 Request processed in 121216us (219323us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1789760762.526200:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:0.0:1789760762.526208:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 366517981585 time 366518137399 state 0x2 ref 0 00000100:00100000:0.0:1789760762.532855:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760762.532952:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863166848 00000100:00100000:1.0:1789760762.532970:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863166848 00000100:00100000:1.0:1789760762.533018:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 366517981585 time 366518137399 state 0x0 ref 1 00000100:00100000:1.0:1789760762.533031:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 366718137399 time 366518137399 state 0x1 ref 1 00000100:00100000:0.0:1789760762.605576:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 366718137399 time 366718760436 state 0x0 ref 1 00000100:00100000:0.0:1789760762.605613:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863166848:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760762.605679:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 19922944, mtime: 0x6aad94f9, atime: 0x6aad94f6, ctime: 0x6aad94f9, blocks: 0x9809 00010000:00010000:0.0:1789760762.605688:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aed8b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760762.605703:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=366s v=(0 0) 00010000:00010000:0.0:1789760762.605707:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760762.605713:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aed8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760762.605735:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aed8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760762.708373:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 19922944 -> 20971520 00002000:00010000:3.0:1789760762.708382:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 38921 -> 40969 00010000:00010000:3.0:1789760762.708407:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aed8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.708420:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aed8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.708428:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aed8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.708435:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627d400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760762.708440:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aed8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.708450:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aed8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.708469:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aed8b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760762.708494:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aed8b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760762.708597:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+7:2349:x1876699863166848:12345-192.168.203.12@tcp:4:dd.500 Request processed in 102998us (175746us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789760762.708608:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:3.0:1789760762.708615:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 366718137399 time 366718760436 state 0x2 ref 0 00000001:00080000:3.0:1789760762.708653:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967471 is committed 00000100:00100000:2.0:1789760762.718381:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760762.719260:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863166976 00000100:00100000:3.0:1789760762.719271:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863166976 00000100:00100000:3.0:1789760762.719327:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 366718137399 time 366718760436 state 0x0 ref 1 00000100:00100000:3.0:1789760762.719340:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 366918760436 time 366718760436 state 0x1 ref 1 00000100:00100000:1.0:1789760762.812937:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 366918760436 time 366926122181 state 0x0 ref 1 00000100:00100000:0.0:1789760762.815023:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ac2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863166976:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760762.815092:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 20971520, mtime: 0x6aad94f9, atime: 0x6aad94f6, ctime: 0x6aad94f9, blocks: 0xa009 00010000:00010000:0.0:1789760762.815102:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aed92 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760762.815130:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=366s v=(0 0) 00010000:00010000:0.0:1789760762.815134:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760762.815140:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aed92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760762.815154:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aed92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760762.896930:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967472 is committed 00002000:00010000:0.0:1789760762.897986:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 20971520 -> 22020096 00002000:00010000:0.0:1789760762.897991:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789760761 -> 1789760762 00002000:00010000:0.0:1789760762.897993:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789760761 -> 1789760762 00002000:00010000:0.0:1789760762.897996:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 40969 -> 43017 00010000:00010000:0.0:1789760762.898010:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aed92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760762.898023:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aed92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760762.898032:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aed92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760762.898040:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627c400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760762.898044:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aed92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760762.898054:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aed92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760762.898088:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aed92 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760762.898096:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aed92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760762.898201:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ac2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863166976:12345-192.168.203.12@tcp:4:dd.500 Request processed in 85242us (179825us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1789760762.899039:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:0.0:1789760762.899049:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 366918760436 time 366926122181 state 0x2 ref 0 00000100:00100000:2.0:1789760762.906282:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760762.906359:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863167104 00000100:00100000:3.0:1789760762.906370:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863167104 00000100:00100000:3.0:1789760762.906433:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 366918760436 time 366926122181 state 0x0 ref 1 00000100:00100000:3.0:1789760762.906449:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 367126122181 time 366926122181 state 0x1 ref 1 00000100:00100000:0.0:1789760763.013109:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 367126122181 time 367126293559 state 0x0 ref 1 00000100:00100000:0.0:1789760763.013147:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d6f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863167104:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760763.013233:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 22020096, mtime: 0x6aad94fa, atime: 0x6aad94f6, ctime: 0x6aad94fa, blocks: 0xa809 00010000:00010000:0.0:1789760763.013242:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aed99 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760763.013258:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=367s v=(0 0) 00010000:00010000:0.0:1789760763.013263:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760763.013269:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aed99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760763.013282:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aed99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760763.080070:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967473 is committed 00002000:00010000:0.0:1789760763.080151:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 22020096 -> 23068672 00002000:00010000:0.0:1789760763.080156:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 43017 -> 45065 00010000:00010000:0.0:1789760763.080179:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aed99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760763.080192:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aed99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760763.080200:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aed99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760763.080207:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627c400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760763.080211:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aed99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760763.080219:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aed99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760763.080238:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aed99 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760763.080245:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aed99 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760763.080341:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d6f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863167104:12345-192.168.203.12@tcp:4:dd.500 Request processed in 67207us (174061us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1789760763.080368:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:0.0:1789760763.080376:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 367126122181 time 367126293559 state 0x2 ref 0 00010000:00010000:2.0:1789760763.088092:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760763.089338:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760763.089941:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863167232 00000100:00100000:1.0:1789760763.089952:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863167232 00000100:00100000:1.0:1789760763.090013:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 367126122181 time 367126293559 state 0x0 ref 1 00000100:00100000:1.0:1789760763.090027:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 367326293559 time 367126293559 state 0x1 ref 1 00000100:00100000:3.0:1789760763.213308:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 367326293559 time 367326494385 state 0x0 ref 1 00000100:00100000:3.0:1789760763.213342:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df142e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863167232:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760763.213458:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 23068672, mtime: 0x6aad94fa, atime: 0x6aad94f6, ctime: 0x6aad94fa, blocks: 0xb009 00010000:00010000:3.0:1789760763.213468:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de391066/0x3e099f5ef04aeda0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.213499:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=367s v=(0 0) 00010000:00010000:3.0:1789760763.213503:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760763.213510:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de391066/0x3e099f5ef04aeda0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760763.213524:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de391066/0x3e099f5ef04aeda0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760763.285500:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967474 is committed 00002000:00010000:0.0:1789760763.285720:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 23068672 -> 24117248 00002000:00010000:0.0:1789760763.285726:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 45065 -> 47113 00010000:00010000:0.0:1789760763.285739:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de391066/0x3e099f5ef04aeda0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760763.285752:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de391066/0x3e099f5ef04aeda0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760763.285761:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de391066/0x3e099f5ef04aeda0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760763.285768:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c4200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760763.285772:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de391066/0x3e099f5ef04aeda0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760763.285781:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de391066/0x3e099f5ef04aeda0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760763.285799:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de391066/0x3e099f5ef04aeda0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760763.285827:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de391066/0x3e099f5ef04aeda0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760763.285942:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df142e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863167232:12345-192.168.203.12@tcp:4:dd.500 Request processed in 72611us (196612us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1789760763.285951:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:0.0:1789760763.285960:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 367326293559 time 367326494385 state 0x2 ref 0 00000100:00100000:0.0:1789760763.291799:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760763.291886:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863167360 00000100:00100000:3.0:1789760763.291899:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863167360 00000100:00100000:3.0:1789760763.291954:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 367326293559 time 367326494385 state 0x0 ref 1 00000100:00100000:3.0:1789760763.291966:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 367526494385 time 367326494385 state 0x1 ref 1 00000100:00100000:0.0:1789760763.414784:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 367526494385 time 367527967322 state 0x0 ref 1 00000100:00100000:0.0:1789760763.414845:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863167360:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760763.414905:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 24117248, mtime: 0x6aad94fa, atime: 0x6aad94f6, ctime: 0x6aad94fa, blocks: 0xb809 00010000:00010000:0.0:1789760763.414915:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6058422/0x3e099f5ef04aeda7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760763.414932:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=367s v=(0 0) 00010000:00010000:0.0:1789760763.414936:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760763.414942:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6058422/0x3e099f5ef04aeda7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760763.414957:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6058422/0x3e099f5ef04aeda7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760763.477432:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967475 is committed 00002000:00010000:0.0:1789760763.478183:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 24117248 -> 25165824 00002000:00010000:0.0:1789760763.478189:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 47113 -> 49161 00010000:00010000:0.0:1789760763.478205:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6058422/0x3e099f5ef04aeda7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760763.478239:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6058422/0x3e099f5ef04aeda7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760763.478248:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6058422/0x3e099f5ef04aeda7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760763.478255:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627da00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760763.478260:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6058422/0x3e099f5ef04aeda7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760763.478270:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6058422/0x3e099f5ef04aeda7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760763.478292:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6058422/0x3e099f5ef04aeda7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760763.478300:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6058422/0x3e099f5ef04aeda7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760763.478599:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863167360:12345-192.168.203.12@tcp:4:dd.500 Request processed in 63791us (186805us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1789760763.478609:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:0.0:1789760763.478618:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 367526494385 time 367527967322 state 0x2 ref 0 00000100:00100000:2.0:1789760763.493181:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760763.493306:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863167488 00000100:00100000:3.0:1789760763.493317:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863167488 00000100:00100000:3.0:1789760763.493375:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 367526494385 time 367527967322 state 0x0 ref 1 00000100:00100000:3.0:1789760763.493400:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 367727967322 time 367527967322 state 0x1 ref 1 00000100:00100000:0.0:1789760763.615042:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 367727967322 time 367728226792 state 0x0 ref 1 00000100:00100000:0.0:1789760763.615089:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df142e40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863167488:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760763.615159:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 25165824, mtime: 0x6aad94fa, atime: 0x6aad94f6, ctime: 0x6aad94fa, blocks: 0xc009 00010000:00010000:0.0:1789760763.615177:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6058422/0x3e099f5ef04aedae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760763.615194:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=367s v=(0 0) 00010000:00010000:0.0:1789760763.615304:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760763.615312:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6058422/0x3e099f5ef04aedae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760763.615329:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6058422/0x3e099f5ef04aedae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760763.709791:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967476 is committed 00002000:00010000:2.0:1789760763.709923:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 25165824 -> 26214400 00002000:00010000:2.0:1789760763.709928:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 49161 -> 51209 00010000:00010000:2.0:1789760763.709941:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6058422/0x3e099f5ef04aedae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760763.709968:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6058422/0x3e099f5ef04aedae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760763.709978:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6058422/0x3e099f5ef04aedae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760763.709985:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627da00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760763.709990:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6058422/0x3e099f5ef04aedae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760763.709999:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6058422/0x3e099f5ef04aedae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760763.710018:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6058422/0x3e099f5ef04aedae lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760763.710027:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6058422/0x3e099f5ef04aedae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760763.710138:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df142e40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863167488:12345-192.168.203.12@tcp:4:dd.500 Request processed in 95057us (216973us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1789760763.710149:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:2.0:1789760763.711739:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 367727967322 time 367728226792 state 0x2 ref 0 00000100:00100000:2.0:1789760763.719386:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760763.719507:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863167616 00000100:00100000:1.0:1789760763.719517:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863167616 00000100:00100000:1.0:1789760763.719573:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 367727967322 time 367728226792 state 0x0 ref 1 00000100:00100000:1.0:1789760763.719586:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 367928226792 time 367728226792 state 0x1 ref 1 00000100:00100000:0.0:1789760763.815186:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 367928226792 time 367928370738 state 0x0 ref 1 00000100:00100000:0.0:1789760763.815220:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863167616:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760763.815302:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 26214400, mtime: 0x6aad94fa, atime: 0x6aad94f6, ctime: 0x6aad94fa, blocks: 0xc809 00010000:00010000:0.0:1789760763.815312:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a99bef87/0x3e099f5ef04aedb5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760763.815328:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=367s v=(0 0) 00010000:00010000:0.0:1789760763.815333:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760763.815339:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a99bef87/0x3e099f5ef04aedb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760763.815375:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a99bef87/0x3e099f5ef04aedb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760763.914265:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967477 is committed 00002000:00010000:2.0:1789760763.914557:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 26214400 -> 27262976 00002000:00010000:2.0:1789760763.914562:0:11799:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789760762 -> 1789760763 00002000:00010000:2.0:1789760763.914564:0:11799:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789760762 -> 1789760763 00002000:00010000:2.0:1789760763.914566:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 51209 -> 53257 00010000:00010000:2.0:1789760763.914580:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a99bef87/0x3e099f5ef04aedb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760763.914593:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a99bef87/0x3e099f5ef04aedb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760763.914601:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a99bef87/0x3e099f5ef04aedb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760763.914608:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627d600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760763.914612:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a99bef87/0x3e099f5ef04aedb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760763.914620:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a99bef87/0x3e099f5ef04aedb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760763.914640:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a99bef87/0x3e099f5ef04aedb5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760763.914646:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a99bef87/0x3e099f5ef04aedb5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760763.914737:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863167616:12345-192.168.203.12@tcp:4:dd.500 Request processed in 99529us (195367us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1789760763.914759:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:2.0:1789760763.914768:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 367928226792 time 367928370738 state 0x2 ref 0 00000100:00100000:2.0:1789760763.923501:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760763.923593:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863167744 00000100:00100000:3.0:1789760763.923603:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863167744 00000100:00100000:3.0:1789760763.924331:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 367928226792 time 367928370738 state 0x0 ref 1 00000100:00100000:3.0:1789760763.924345:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 368128370738 time 367928370738 state 0x1 ref 1 00000100:00100000:0.0:1789760764.015516:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 368128370738 time 368128700022 state 0x0 ref 1 00000100:00100000:0.0:1789760764.015572:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863167744:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760764.015646:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 27262976, mtime: 0x6aad94fb, atime: 0x6aad94f6, ctime: 0x6aad94fb, blocks: 0xd009 00010000:00010000:0.0:1789760764.015658:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d309408/0x3e099f5ef04aedbc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.015676:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=368s v=(0 0) 00010000:00010000:0.0:1789760764.015680:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760764.015687:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d309408/0x3e099f5ef04aedbc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.015701:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d309408/0x3e099f5ef04aedbc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789760764.016956:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789760764.063704:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967478 is committed 00002000:00010000:0.0:1789760764.063795:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 27262976 -> 28311552 00002000:00010000:0.0:1789760764.063816:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 53257 -> 55305 00010000:00010000:0.0:1789760764.063832:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d309408/0x3e099f5ef04aedbc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.063845:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d309408/0x3e099f5ef04aedbc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.063868:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d309408/0x3e099f5ef04aedbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.063942:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627c000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760764.063949:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d309408/0x3e099f5ef04aedbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.063959:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d309408/0x3e099f5ef04aedbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.063978:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d309408/0x3e099f5ef04aedbc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.063987:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d309408/0x3e099f5ef04aedbc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760764.064092:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863167744:12345-192.168.203.12@tcp:4:dd.500 Request processed in 48552us (140596us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1789760764.064102:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:0.0:1789760764.064110:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 368128370738 time 368128700022 state 0x2 ref 0 00000100:00100000:3.0:1789760764.076713:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760764.076797:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863167872 00000100:00100000:2.0:1789760764.076844:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863167872 00000100:00100000:2.0:1789760764.076900:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 368128370738 time 368128700022 state 0x0 ref 1 00000100:00100000:2.0:1789760764.076913:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 368328700022 time 368128700022 state 0x1 ref 1 00010000:00010000:1.0:1789760764.114030:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760764.216292:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 368328700022 time 368329476953 state 0x0 ref 1 00000100:00100000:2.0:1789760764.216328:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14238d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863167872:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760764.216390:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 28311552, mtime: 0x6aad94fb, atime: 0x6aad94f6, ctime: 0x6aad94fb, blocks: 0xd809 00010000:00010000:2.0:1789760764.216400:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a6c5da4/0x3e099f5ef04aedc3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760764.216417:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=368s v=(0 0) 00010000:00010000:2.0:1789760764.216422:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760764.216428:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a6c5da4/0x3e099f5ef04aedc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760764.216443:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a6c5da4/0x3e099f5ef04aedc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760764.275440:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967479 is committed 00002000:00010000:0.0:1789760764.275488:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 28311552 -> 29360128 00002000:00010000:0.0:1789760764.275493:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 55305 -> 57353 00010000:00010000:0.0:1789760764.275507:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a6c5da4/0x3e099f5ef04aedc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.275540:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a6c5da4/0x3e099f5ef04aedc3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.275550:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a6c5da4/0x3e099f5ef04aedc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.275557:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760764.275562:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a6c5da4/0x3e099f5ef04aedc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.275572:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a6c5da4/0x3e099f5ef04aedc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.275591:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a6c5da4/0x3e099f5ef04aedc3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.275599:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a6c5da4/0x3e099f5ef04aedc3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760764.275856:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14238d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863167872:12345-192.168.203.12@tcp:4:dd.500 Request processed in 59541us (199147us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1789760764.275866:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:0.0:1789760764.275878:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 368328700022 time 368329476953 state 0x2 ref 0 00000100:00100000:1.0:1789760764.288724:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760764.288963:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863168000 00000100:00100000:0.0:1789760764.288988:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863168000 00000100:00100000:0.0:1789760764.289042:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 368328700022 time 368329476953 state 0x0 ref 1 00000100:00100000:0.0:1789760764.289055:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 368529476953 time 368329476953 state 0x1 ref 1 00000100:00100000:2.0:1789760764.416939:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 368529476953 time 368530123059 state 0x0 ref 1 00000100:00100000:2.0:1789760764.416985:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ad64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863168000:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760764.417042:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 29360128, mtime: 0x6aad94fb, atime: 0x6aad94f6, ctime: 0x6aad94fb, blocks: 0xe009 00010000:00010000:2.0:1789760764.417051:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aedca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760764.417066:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=368s v=(0 0) 00010000:00010000:2.0:1789760764.417071:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760764.417077:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aedca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760764.417092:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aedca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760764.504669:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967480 is committed 00002000:00010000:0.0:1789760764.508077:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 29360128 -> 30408704 00002000:00010000:0.0:1789760764.508086:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 57353 -> 59401 00010000:00010000:0.0:1789760764.508101:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aedca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.508113:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aedca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.508121:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aedca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.508128:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760764.508133:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aedca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.508142:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aedca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.508170:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aedca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.508184:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aedca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760764.508308:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ad64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863168000:12345-192.168.203.12@tcp:4:dd.500 Request processed in 91333us (219589us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1789760764.508319:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:0.0:1789760764.508536:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 368529476953 time 368530123059 state 0x2 ref 0 00000100:00100000:0.0:1789760764.514554:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760764.515582:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863168128 00000100:00100000:3.0:1789760764.515595:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863168128 00000100:00100000:3.0:1789760764.515649:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 368529476953 time 368530123059 state 0x0 ref 1 00000100:00100000:3.0:1789760764.515663:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 368730123059 time 368530123059 state 0x1 ref 1 00000100:00100000:3.0:1789760764.530724:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760764.530766:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760764.530797:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760764.530838:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760764.530978:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863168384 00000100:00100000:3.0:1789760764.530988:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863168384 00000100:00100000:3.0:1789760764.531043:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863168640 00000100:00100000:3.0:1789760764.531047:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863168640 00000100:00100000:3.0:1789760764.531073:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 178 00000100:00100000:3.0:1789760764.531083:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14238ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+8:2349:x1876699863168384:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760764.531168:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14238ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+8:2349:x1876699863168384:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 72us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760764.531176:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 178 00000100:00100000:3.0:1789760764.531193:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 179 00000100:00100000:3.0:1789760764.531200:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14238f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2349:x1876699863168640:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760764.531228:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14238f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2349:x1876699863168640:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 28us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760764.531234:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 179 00000100:00100000:1.0:1789760764.531713:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863168256 00000100:00100000:1.0:1789760764.531719:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863168256 00000100:00100000:1.0:1789760764.531758:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 283 00000100:00100000:1.0:1789760764.531775:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2349:x1876699863168256:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1789760764.531837:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2349:x1876699863168256:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 71us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760764.531844:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 283 00000100:00100000:1.0:1789760764.531891:0:12460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863168512 00000100:00100000:1.0:1789760764.531901:0:12460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863168512 00000100:00100000:1.0:1789760764.531934:0:12460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 103 00000100:00100000:1.0:1789760764.531941:0:12460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14238c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863168512:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1789760764.531971:0:12460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14238c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863168512:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 30us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760764.531977:0:12460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 103 00000100:00080000:1.0:1789760764.531993:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789760764.531998:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789760764.582538:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967345 is committed 00000100:00100000:0.0:1789760764.617146:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 368730123059 time 368730325437 state 0x0 ref 1 00000100:00100000:0.0:1789760764.617204:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863168128:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760764.617300:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 30408704, mtime: 0x6aad94fb, atime: 0x6aad94f6, ctime: 0x6aad94fb, blocks: 0xe809 00010000:00010000:0.0:1789760764.617311:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b14faf1a/0x3e099f5ef04aedd1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.617332:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=368s v=(0 0) 00010000:00010000:0.0:1789760764.617338:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760764.617345:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b14faf1a/0x3e099f5ef04aedd1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.617362:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b14faf1a/0x3e099f5ef04aedd1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760764.724017:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 30408704 -> 31457280 00002000:00010000:3.0:1789760764.724031:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 59401 -> 61449 00010000:00010000:3.0:1789760764.724050:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b14faf1a/0x3e099f5ef04aedd1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.724084:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b14faf1a/0x3e099f5ef04aedd1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.724095:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b14faf1a/0x3e099f5ef04aedd1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.724104:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627c800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760764.724110:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b14faf1a/0x3e099f5ef04aedd1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.724122:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b14faf1a/0x3e099f5ef04aedd1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.724147:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b14faf1a/0x3e099f5ef04aedd1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.724170:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b14faf1a/0x3e099f5ef04aedd1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760764.724309:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+7:2351:x1876699863168128:12345-192.168.203.12@tcp:4:dd.500 Request processed in 107123us (209755us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1789760764.724321:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:3.0:1789760764.724331:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 368730123059 time 368730325437 state 0x2 ref 0 00000001:00080000:2.0:1789760764.725052:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967481 is committed 00000100:00100000:3.0:1789760764.731197:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760764.731353:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863168768 00000100:00100000:2.0:1789760764.731367:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863168768 00000100:00100000:2.0:1789760764.731456:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 368730123059 time 368730325437 state 0x0 ref 1 00000100:00100000:2.0:1789760764.731471:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 368930325437 time 368730325437 state 0x1 ref 1 00000100:00100000:0.0:1789760764.817361:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 368930325437 time 368930540330 state 0x0 ref 1 00000100:00100000:0.0:1789760764.817488:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14238dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863168768:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760764.817594:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 31457280, mtime: 0x6aad94fb, atime: 0x6aad94f6, ctime: 0x6aad94fb, blocks: 0xf009 00010000:00010000:0.0:1789760764.817605:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aedd8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.817626:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=368s v=(0 0) 00010000:00010000:0.0:1789760764.817632:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760764.817640:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aedd8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.817658:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aedd8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760764.921026:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967482 is committed 00002000:00010000:3.0:1789760764.922244:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 31457280 -> 32505856 00002000:00010000:3.0:1789760764.922250:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789760763 -> 1789760764 00002000:00010000:3.0:1789760764.922253:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789760763 -> 1789760764 00002000:00010000:3.0:1789760764.922255:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 61449 -> 63497 00010000:00010000:3.0:1789760764.922269:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aedd8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.922282:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aedd8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.922292:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aedd8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.922299:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627d000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760764.922303:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aedd8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.922313:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aedd8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.922337:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aedd8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.922345:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aedd8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760764.922450:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14238dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863168768:12345-192.168.203.12@tcp:4:dd.500 Request processed in 104984us (191262us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1789760764.922475:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:3.0:1789760764.922483:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 368930325437 time 368930540330 state 0x2 ref 0 00000100:00100000:0.0:1789760764.935033:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760764.935120:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863168896 00000100:00100000:3.0:1789760764.935130:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863168896 00000100:00100000:3.0:1789760764.935191:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 368930325437 time 368930540330 state 0x0 ref 1 00000100:00100000:3.0:1789760764.935205:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 369130540330 time 368930540330 state 0x1 ref 1 00000100:00100000:0.0:1789760765.018108:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 369130540330 time 369131293294 state 0x0 ref 1 00000100:00100000:0.0:1789760765.018142:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863168896:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760765.018211:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 32505856, mtime: 0x6aad94fc, atime: 0x6aad94f6, ctime: 0x6aad94fc, blocks: 0xf809 00010000:00010000:0.0:1789760765.018221:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d309408/0x3e099f5ef04aeddf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760765.018236:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=369s v=(0 0) 00010000:00010000:0.0:1789760765.018239:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760765.018245:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d309408/0x3e099f5ef04aeddf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760765.018259:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d309408/0x3e099f5ef04aeddf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760765.082340:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967483 is committed 00002000:00010000:3.0:1789760765.082529:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 32505856 -> 33554432 00002000:00010000:3.0:1789760765.082534:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 63497 -> 65545 00010000:00010000:3.0:1789760765.082550:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d309408/0x3e099f5ef04aeddf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760765.082563:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d309408/0x3e099f5ef04aeddf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760765.082571:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d309408/0x3e099f5ef04aeddf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760765.082579:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627c000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760765.082584:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d309408/0x3e099f5ef04aeddf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760765.082593:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d309408/0x3e099f5ef04aeddf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760765.082614:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d309408/0x3e099f5ef04aeddf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760765.082639:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d309408/0x3e099f5ef04aeddf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760765.082734:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863168896:12345-192.168.203.12@tcp:4:dd.500 Request processed in 64605us (147706us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1789760765.082745:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:3.0:1789760765.082753:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 369130540330 time 369131293294 state 0x2 ref 0 00000100:00100000:3.0:1789760765.098953:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760765.099173:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863169024 00000100:00100000:2.0:1789760765.099184:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863169024 00000100:00100000:3.0:1789760765.104196:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 369130540330 time 369131293294 state 0x0 ref 1 00000100:00100000:3.0:1789760765.104212:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 369331293294 time 369131293294 state 0x1 ref 1 00010000:00010000:2.0:1789760765.137382:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760765.218445:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 369331293294 time 369331629794 state 0x0 ref 1 00000100:00100000:3.0:1789760765.218480:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14238e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863169024:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760765.218538:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 33554432, mtime: 0x6aad94fc, atime: 0x6aad94f6, ctime: 0x6aad94fc, blocks: 0x10009 00010000:00010000:3.0:1789760765.218547:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002381140b/0x3e099f5ef04aede6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760765.218564:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=369s v=(0 0) 00010000:00010000:3.0:1789760765.218569:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760765.218575:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002381140b/0x3e099f5ef04aede6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760765.218590:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002381140b/0x3e099f5ef04aede6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760765.282097:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 33554432 -> 34603008 00002000:00010000:3.0:1789760765.282106:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 65545 -> 67593 00010000:00010000:3.0:1789760765.282120:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002381140b/0x3e099f5ef04aede6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760765.282132:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002381140b/0x3e099f5ef04aede6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760765.282140:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002381140b/0x3e099f5ef04aede6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760765.282146:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c5800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760765.282161:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002381140b/0x3e099f5ef04aede6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760765.282170:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002381140b/0x3e099f5ef04aede6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760765.282188:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002381140b/0x3e099f5ef04aede6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760765.282196:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002381140b/0x3e099f5ef04aede6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760765.282295:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14238e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+7:2350:x1876699863169024:12345-192.168.203.12@tcp:4:dd.500 Request processed in 63827us (183349us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1789760765.282318:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:3.0:1789760765.282326:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 369331293294 time 369331629794 state 0x2 ref 0 00000001:00080000:0.0:1789760765.282693:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967484 is committed 00000100:00100000:1.0:1789760765.290317:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760765.290591:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863169152 00000100:00100000:2.0:1789760765.290602:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863169152 00000100:00100000:2.0:1789760765.290672:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 369331293294 time 369331629794 state 0x0 ref 1 00000100:00100000:2.0:1789760765.290684:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 369531629794 time 369331629794 state 0x1 ref 1 00000100:00100000:3.0:1789760765.418668:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 369531629794 time 369531851194 state 0x0 ref 1 00000100:00100000:3.0:1789760765.418705:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ad65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863169152:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760765.418763:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 34603008, mtime: 0x6aad94fc, atime: 0x6aad94f6, ctime: 0x6aad94fc, blocks: 0x10809 00010000:00010000:3.0:1789760765.418773:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002381140b/0x3e099f5ef04aeded lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760765.418789:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=369s v=(0 0) 00010000:00010000:3.0:1789760765.418794:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760765.418838:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002381140b/0x3e099f5ef04aeded lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760765.418854:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002381140b/0x3e099f5ef04aeded lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760765.492319:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 34603008 -> 35651584 00002000:00010000:2.0:1789760765.492329:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 67593 -> 69641 00010000:00010000:2.0:1789760765.492344:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002381140b/0x3e099f5ef04aeded lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760765.492356:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002381140b/0x3e099f5ef04aeded lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760765.492364:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002381140b/0x3e099f5ef04aeded lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760765.492372:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c5800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760765.492377:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002381140b/0x3e099f5ef04aeded lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760765.492385:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002381140b/0x3e099f5ef04aeded lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760765.492404:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002381140b/0x3e099f5ef04aeded lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760765.492412:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002381140b/0x3e099f5ef04aeded lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760765.492528:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ad65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+7:2348:x1876699863169152:12345-192.168.203.12@tcp:4:dd.500 Request processed in 73836us (202216us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1789760765.492540:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:2.0:1789760765.492548:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 369531629794 time 369531851194 state 0x2 ref 0 00000001:00080000:0.0:1789760765.492798:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967485 is committed 00000100:00100000:2.0:1789760765.505193:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760765.505468:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863169280 00000100:00100000:3.0:1789760765.505478:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863169280 00000100:00100000:3.0:1789760765.505534:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 369531629794 time 369531851194 state 0x0 ref 1 00000100:00100000:3.0:1789760765.505653:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 369731851194 time 369531851194 state 0x1 ref 1 00000100:00100000:2.0:1789760765.519992:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14238fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883059584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760765.520061:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760765.520184:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883059584 00000100:00100000:0.0:1789760765.520193:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883059584 00000100:00100000:0.0:1789760765.520259:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789760765.520270:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883059584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789760765.520294:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 129433600 pending 0 free 3832545280 avail 3822059520 00000100:00080000:1.0:1789760765.520454:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760765.527099:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883059584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6821us (7027us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760765.527114:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789760765.529317:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14238fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883059584:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1789760765.563006:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000100:00100000:0.0:1789760765.563176:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14ad64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883059712:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789760765.563239:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760765.563357:0:12459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883059712 00000100:00100000:1.0:1789760765.563375:0:12459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883059712 00000100:00100000:1.0:1789760765.563435:0:12459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789760765.563445:0:12459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883059712:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789760765.563470:0:12459:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6 count 1 00002000:00010000:1.0:1789760765.563504:0:12459:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 8388608, mtime: 0x6aad94f3, atime: 0x6aad94f1, ctime: 0x6aad94f3, blocks: 0x4007 00010000:00010000:1.0:1789760765.563512:0:12459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000278bde42/0x3e099f5ef04aedf4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760765.563528:0:12459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=369s v=(0 0) 00010000:00010000:1.0:1789760765.563533:0:12459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760765.563539:0:12459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000278bde42/0x3e099f5ef04aedf4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760765.563556:0:12459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000278bde42/0x3e099f5ef04aedf4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760765.563584:0:12459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000278bde42/0x3e099f5ef04aedf4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760765.563591:0:12459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000278bde42/0x3e099f5ef04aedf4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760765.563606:0:12459:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1789760765.564372:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789760765.564537:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789760765.564544:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000278bde42/0x3e099f5ef04aedf4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760765.564555:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861fa00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760765.564559:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000278bde42/0x3e099f5ef04aedf4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760765.564569:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000278bde42/0x3e099f5ef04aedf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760765.564586:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000278bde42/0x3e099f5ef04aedf4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760765.564592:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000278bde42/0x3e099f5ef04aedf4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760765.564620:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760765.564622:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760765.564624:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760765.564923:0:12459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3309:x1876699883059712:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1478us (1681us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1789760765.564932:0:12459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789760765.565026:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967345 gen 2 00000004:00080000:0.0:1789760765.565032:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df14ad66680, transno 4294967345 00000100:00100000:0.0:1789760765.565049:0:3309:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8df14ad64000 x1876699883059712/t4294967346(4294967346) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789760781 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789760765.565060:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df14ad64000/2, rc 0, transno 4294967346 00000100:00100000:0.0:1789760765.565065:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14ad64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883059712:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789760765.618891:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 369731851194 time 369732077371 state 0x0 ref 1 00000100:00100000:3.0:1789760765.618928:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c650380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863169280:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760765.619006:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 35651584, mtime: 0x6aad94fc, atime: 0x6aad94f6, ctime: 0x6aad94fc, blocks: 0x11009 00010000:00010000:3.0:1789760765.619014:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078ab58e4/0x3e099f5ef04aedfb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760765.619030:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=369s v=(0 0) 00010000:00010000:3.0:1789760765.619034:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760765.619042:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078ab58e4/0x3e099f5ef04aedfb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760765.619056:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078ab58e4/0x3e099f5ef04aedfb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760765.662182:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967486 is committed 00002000:00010000:3.0:1789760765.662280:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 35651584 -> 36700160 00002000:00010000:3.0:1789760765.662285:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 69641 -> 71689 00010000:00010000:3.0:1789760765.662300:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078ab58e4/0x3e099f5ef04aedfb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760765.662314:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078ab58e4/0x3e099f5ef04aedfb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760765.662323:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078ab58e4/0x3e099f5ef04aedfb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760765.662331:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c5e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760765.662335:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078ab58e4/0x3e099f5ef04aedfb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760765.662361:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078ab58e4/0x3e099f5ef04aedfb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760765.662395:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078ab58e4/0x3e099f5ef04aedfb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760765.662404:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078ab58e4/0x3e099f5ef04aedfb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760765.662502:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c650380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863169280:12345-192.168.203.12@tcp:4:dd.500 Request processed in 43588us (157315us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1789760765.662512:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:3.0:1789760765.662520:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 369731851194 time 369732077371 state 0x2 ref 0 00000100:00100000:3.0:1789760765.666087:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760765.666186:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863169408 00000100:00100000:1.0:1789760765.666195:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863169408 00000100:00100000:1.0:1789760765.666242:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 369731851194 time 369732077371 state 0x0 ref 1 00000100:00100000:1.0:1789760765.666254:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 369932077371 time 369732077371 state 0x1 ref 1 00000100:00100000:3.0:1789760765.819136:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 369932077371 time 369932322550 state 0x0 ref 1 00000100:00100000:3.0:1789760765.819179:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14238d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863169408:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760765.819235:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 36700160, mtime: 0x6aad94fc, atime: 0x6aad94f6, ctime: 0x6aad94fc, blocks: 0x11809 00010000:00010000:3.0:1789760765.819253:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078ab58e4/0x3e099f5ef04aee02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760765.819270:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=369s v=(0 0) 00010000:00010000:3.0:1789760765.819275:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760765.819281:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078ab58e4/0x3e099f5ef04aee02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760765.819308:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078ab58e4/0x3e099f5ef04aee02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760765.905867:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967487 is committed 00002000:00010000:1.0:1789760765.909823:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 36700160 -> 37748736 00002000:00010000:1.0:1789760765.909831:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789760764 -> 1789760765 00002000:00010000:1.0:1789760765.909833:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789760764 -> 1789760765 00002000:00010000:1.0:1789760765.909835:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 71689 -> 73737 00010000:00010000:1.0:1789760765.909852:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078ab58e4/0x3e099f5ef04aee02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760765.909866:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078ab58e4/0x3e099f5ef04aee02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760765.909892:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078ab58e4/0x3e099f5ef04aee02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760765.909899:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c5e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760765.909904:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078ab58e4/0x3e099f5ef04aee02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760765.909912:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078ab58e4/0x3e099f5ef04aee02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760765.910073:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078ab58e4/0x3e099f5ef04aee02 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760765.910083:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078ab58e4/0x3e099f5ef04aee02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760765.910312:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14238d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863169408:12345-192.168.203.12@tcp:4:dd.500 Request processed in 91144us (244228us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1789760765.910322:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:1.0:1789760765.910330:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 369932077371 time 369932322550 state 0x2 ref 0 00000100:00100000:3.0:1789760765.924188:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760765.924691:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863169536 00000100:00100000:2.0:1789760765.924702:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863169536 00000100:00100000:2.0:1789760765.924756:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 369932077371 time 369932322550 state 0x0 ref 1 00000100:00100000:2.0:1789760765.924769:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 370132322550 time 369932322550 state 0x1 ref 1 00000100:00100000:2.0:1789760766.019293:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 370132322550 time 370132479043 state 0x0 ref 1 00000100:00100000:2.0:1789760766.019347:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14238f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863169536:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760766.019416:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 37748736, mtime: 0x6aad94fd, atime: 0x6aad94f6, ctime: 0x6aad94fd, blocks: 0x12009 00010000:00010000:2.0:1789760766.019425:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ead603cd/0x3e099f5ef04aee09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760766.019442:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=370s v=(0 0) 00010000:00010000:2.0:1789760766.019446:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760766.019452:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ead603cd/0x3e099f5ef04aee09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789760766.019651:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789760766.019696:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ead603cd/0x3e099f5ef04aee09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760766.097402:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967488 is committed 00002000:00010000:0.0:1789760766.097557:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 37748736 -> 38797312 00002000:00010000:0.0:1789760766.097562:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 73737 -> 75785 00010000:00010000:0.0:1789760766.097576:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ead603cd/0x3e099f5ef04aee09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760766.097608:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ead603cd/0x3e099f5ef04aee09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760766.097617:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ead603cd/0x3e099f5ef04aee09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760766.097625:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760766.097630:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ead603cd/0x3e099f5ef04aee09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760766.097639:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ead603cd/0x3e099f5ef04aee09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760766.097661:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ead603cd/0x3e099f5ef04aee09 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760766.097669:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ead603cd/0x3e099f5ef04aee09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760766.097766:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14238f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863169536:12345-192.168.203.12@tcp:4:dd.500 Request processed in 78450us (173583us total) trans 4294967488 rc 0/0 00000100:00100000:0.0:1789760766.097776:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:0.0:1789760766.097784:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 370132322550 time 370132479043 state 0x2 ref 0 00000100:00100000:3.0:1789760766.109913:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760766.110009:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863169664 00000100:00100000:0.0:1789760766.110030:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863169664 00000100:00100000:0.0:1789760766.110083:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 370132322550 time 370132479043 state 0x0 ref 1 00000100:00100000:0.0:1789760766.110097:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 370332479043 time 370132479043 state 0x1 ref 1 00010000:00010000:1.0:1789760766.159355:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760766.220638:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 370332479043 time 370333822077 state 0x0 ref 1 00000100:00100000:3.0:1789760766.220673:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14238ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863169664:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760766.220736:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 38797312, mtime: 0x6aad94fd, atime: 0x6aad94f6, ctime: 0x6aad94fd, blocks: 0x12809 00010000:00010000:3.0:1789760766.220746:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f7300d2/0x3e099f5ef04aee10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.220763:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=370s v=(0 0) 00010000:00010000:3.0:1789760766.220767:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760766.220773:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f7300d2/0x3e099f5ef04aee10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.220788:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f7300d2/0x3e099f5ef04aee10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760766.296324:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967489 is committed 00002000:00010000:1.0:1789760766.296453:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 38797312 -> 39845888 00002000:00010000:1.0:1789760766.296526:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 75785 -> 77833 00010000:00010000:1.0:1789760766.296544:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f7300d2/0x3e099f5ef04aee10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760766.298934:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f7300d2/0x3e099f5ef04aee10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760766.298945:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f7300d2/0x3e099f5ef04aee10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760766.298954:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c4600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760766.298959:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f7300d2/0x3e099f5ef04aee10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760766.298970:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f7300d2/0x3e099f5ef04aee10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760766.298993:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f7300d2/0x3e099f5ef04aee10 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760766.299001:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f7300d2/0x3e099f5ef04aee10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760766.299176:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14238ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863169664:12345-192.168.203.12@tcp:4:dd.500 Request processed in 78516us (189269us total) trans 4294967489 rc 0/0 00000100:00100000:1.0:1789760766.299187:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:1.0:1789760766.299196:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 370332479043 time 370333822077 state 0x2 ref 0 00000100:00100000:3.0:1789760766.308065:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760766.308198:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863169792 00000100:00100000:1.0:1789760766.308222:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863169792 00000100:00100000:1.0:1789760766.308280:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 370332479043 time 370333822077 state 0x0 ref 1 00000100:00100000:1.0:1789760766.308295:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 370533822077 time 370333822077 state 0x1 ref 1 00000100:00100000:1.0:1789760766.421215:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 370533822077 time 370534399180 state 0x0 ref 1 00000100:00100000:1.0:1789760766.421251:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14238c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863169792:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760766.421311:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 39845888, mtime: 0x6aad94fd, atime: 0x6aad94f6, ctime: 0x6aad94fd, blocks: 0x13009 00010000:00010000:1.0:1789760766.421320:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea5f19f5/0x3e099f5ef04aee17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760766.421336:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=370s v=(0 0) 00010000:00010000:1.0:1789760766.421341:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760766.421348:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea5f19f5/0x3e099f5ef04aee17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760766.421374:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea5f19f5/0x3e099f5ef04aee17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760766.477662:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967490 is committed 00002000:00010000:0.0:1789760766.477853:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 39845888 -> 40894464 00002000:00010000:0.0:1789760766.477858:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 77833 -> 79881 00010000:00010000:0.0:1789760766.477872:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea5f19f5/0x3e099f5ef04aee17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760766.477885:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea5f19f5/0x3e099f5ef04aee17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760766.477894:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea5f19f5/0x3e099f5ef04aee17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760766.477902:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861f200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760766.477907:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea5f19f5/0x3e099f5ef04aee17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760766.477915:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea5f19f5/0x3e099f5ef04aee17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760766.477936:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea5f19f5/0x3e099f5ef04aee17 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760766.477944:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea5f19f5/0x3e099f5ef04aee17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760766.478073:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14238c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863169792:12345-192.168.203.12@tcp:4:dd.500 Request processed in 56835us (170014us total) trans 4294967490 rc 0/0 00000100:00100000:0.0:1789760766.478084:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:0.0:1789760766.478093:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 370533822077 time 370534399180 state 0x2 ref 0 00000100:00100000:0.0:1789760766.483707:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760766.484019:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863169920 00000100:00100000:2.0:1789760766.484037:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863169920 00000100:00100000:2.0:1789760766.484102:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 370533822077 time 370534399180 state 0x0 ref 1 00000100:00100000:2.0:1789760766.484115:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 370734399180 time 370534399180 state 0x1 ref 1 00000100:00100000:0.0:1789760766.623374:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 370734399180 time 370736559385 state 0x0 ref 1 00000100:00100000:1.0:1789760766.624538:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863169920:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760766.624604:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 40894464, mtime: 0x6aad94fd, atime: 0x6aad94f6, ctime: 0x6aad94fd, blocks: 0x13809 00010000:00010000:1.0:1789760766.624612:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aee1e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760766.624628:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=370s v=(0 0) 00010000:00010000:1.0:1789760766.624633:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760766.624650:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aee1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760766.624665:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aee1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760766.670002:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967491 is committed 00002000:00010000:2.0:1789760766.670211:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 40894464 -> 41943040 00002000:00010000:2.0:1789760766.670216:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 79881 -> 81929 00010000:00010000:2.0:1789760766.670231:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aee1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760766.670245:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aee1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760766.670254:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aee1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760766.670262:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861ea00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760766.670267:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aee1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760766.670277:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aee1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760766.670298:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aee1e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760766.670307:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aee1e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760766.670712:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863169920:12345-192.168.203.12@tcp:4:dd.500 Request processed in 47315us (187009us total) trans 4294967491 rc 0/0 00000100:00100000:2.0:1789760766.670723:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:2.0:1789760766.670732:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 370734399180 time 370736559385 state 0x2 ref 0 00000100:00100000:0.0:1789760766.677590:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760766.677695:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863170048 00000100:00100000:1.0:1789760766.677705:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863170048 00000100:00100000:1.0:1789760766.677760:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 370734399180 time 370736559385 state 0x0 ref 1 00000100:00100000:1.0:1789760766.677773:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 370936559385 time 370736559385 state 0x1 ref 1 00000100:00100000:1.0:1789760766.823476:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 370936559385 time 370936659728 state 0x0 ref 1 00000100:00100000:1.0:1789760766.823510:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863170048:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760766.823579:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 41943040, mtime: 0x6aad94fd, atime: 0x6aad94f6, ctime: 0x6aad94fd, blocks: 0x14009 00010000:00010000:1.0:1789760766.823589:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000486a4f5f/0x3e099f5ef04aee25 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760766.823605:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=370s v=(0 0) 00010000:00010000:1.0:1789760766.823610:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760766.823617:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000486a4f5f/0x3e099f5ef04aee25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760766.823631:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000486a4f5f/0x3e099f5ef04aee25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760766.926291:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967492 is committed 00002000:00010000:0.0:1789760766.926411:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 41943040 -> 42991616 00002000:00010000:0.0:1789760766.926416:0:11799:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789760765 -> 1789760766 00002000:00010000:0.0:1789760766.926420:0:11799:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789760765 -> 1789760766 00002000:00010000:0.0:1789760766.926422:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 81929 -> 83979 00010000:00010000:0.0:1789760766.926437:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000486a4f5f/0x3e099f5ef04aee25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760766.926450:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000486a4f5f/0x3e099f5ef04aee25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760766.926461:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000486a4f5f/0x3e099f5ef04aee25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760766.926468:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861f400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760766.926472:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000486a4f5f/0x3e099f5ef04aee25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760766.926495:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000486a4f5f/0x3e099f5ef04aee25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760766.926519:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000486a4f5f/0x3e099f5ef04aee25 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760766.926527:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000486a4f5f/0x3e099f5ef04aee25 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760766.926727:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863170048:12345-192.168.203.12@tcp:4:dd.500 Request processed in 103227us (249142us total) trans 4294967492 rc 0/0 00000100:00100000:0.0:1789760766.926738:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:0.0:1789760766.926746:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 370936559385 time 370936659728 state 0x2 ref 0 00000100:00100000:2.0:1789760766.936970:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760766.937080:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863170176 00000100:00100000:1.0:1789760766.937091:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863170176 00000100:00100000:1.0:1789760766.937163:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 370936559385 time 370936659728 state 0x0 ref 1 00000100:00100000:1.0:1789760766.937177:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 371136659728 time 370936659728 state 0x1 ref 1 00000100:00100000:0.0:1789760767.025451:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 371136659728 time 371138635977 state 0x0 ref 1 00000100:00100000:0.0:1789760767.025491:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27c653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863170176:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760767.025553:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 42991616, mtime: 0x6aad94fe, atime: 0x6aad94f6, ctime: 0x6aad94fe, blocks: 0x1480b 00010000:00010000:0.0:1789760767.025563:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aee2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760767.025580:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=371s v=(0 0) 00010000:00010000:0.0:1789760767.025586:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760767.025592:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aee2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760767.025626:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aee2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760767.056691:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df259bd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883059840:0@lo:400:kworker.0 00000100:00100000:2.0:1789760767.056764:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760767.056888:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883059840 00000100:00100000:3.0:1789760767.056896:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883059840 00000100:00100000:3.0:1789760767.056953:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1789760767.056962:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883059840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760767.058577:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883059840:12345-0@lo:400:kworker.0 Request processed in 1611us (1807us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760767.058589:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1789760767.058878:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df259bd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883059968:0@lo:400:kworker.0 00000100:00100000:1.0:1789760767.058936:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760767.059942:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883059968 00000100:00100000:3.0:1789760767.059951:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883059968 00000100:00100000:3.0:1789760767.059999:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789760767.060009:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ad66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883059968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760767.060073:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ad66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883059968:12345-0@lo:400:kworker.0 Request processed in 65us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760767.060080:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789760767.060209:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df259bd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883059968:0@lo:400:kworker.0 00000100:00100000:3.0:1789760767.062635:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df259bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883060096:0@lo:400:kworker.0 00000100:00100000:3.0:1789760767.062712:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760767.063013:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df259bd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883059840:0@lo:400:kworker.0 00000100:00100000:1.0:1789760767.063566:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883060096 00000100:00100000:1.0:1789760767.063586:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883060096 00000100:00100000:1.0:1789760767.063682:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789760767.063694:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14238fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883060096:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789760767.063730:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760767.064069:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14238fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883060096:12345-0@lo:400:kworker.0 Request processed in 374us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760767.064078:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789760767.064861:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df259bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883060096:0@lo:400:kworker.0 00000100:00100000:3.0:1789760767.064889:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789760767.064898:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df259bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883060224:0@lo:400:kworker.0 00000100:00100000:3.0:1789760767.064962:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760767.065477:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883060224 00000100:00100000:2.0:1789760767.065485:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883060224 00000100:00100000:2.0:1789760767.065556:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789760767.065566:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2513df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883060224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760767.065624:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2513df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883060224:12345-0@lo:400:kworker.0 Request processed in 60us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760767.065632:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789760767.065671:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df259bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883060224:0@lo:400:kworker.0 00000100:00080000:3.0:1789760767.067291:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760767.067648:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df259bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1876699883060352:0@lo:400:kworker.0 00000100:00100000:2.0:1789760767.067718:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760767.068347:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883060352 00000100:00100000:3.0:1789760767.068356:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883060352 00000100:00100000:3.0:1789760767.068428:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789760767.068438:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876699883060352:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789760767.068511:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760767.068955:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df259bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883060480:0@lo:400:kworker.0 00000100:00100000:1.0:1789760767.068995:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760767.069035:0:12460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883060480 00000100:00100000:1.0:1789760767.069040:0:12460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883060480 00000100:00100000:1.0:1789760767.069087:0:12460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789760767.069095:0:12460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ad65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3311:x1876699883060480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760767.069147:0:12460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ad65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3311:x1876699883060480:12345-0@lo:400:kworker.0 Request processed in 42us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760767.069155:0:12460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:1.0:1789760767.069177:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789760767.069218:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df259bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883060480:0@lo:400:kworker.0 00000100:00100000:3.0:1789760767.070494:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876699883060352:12345-0@lo:400:kworker.0 Request processed in 2051us (2768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760767.070507:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789760767.070989:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df259bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1876699883060352:0@lo:400:kworker.0 00000001:00080000:2.0:1789760767.087500:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967493 is committed 00002000:00010000:0.0:1789760767.087676:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 42991616 -> 44040192 00002000:00010000:0.0:1789760767.087683:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 83979 -> 86027 00010000:00010000:0.0:1789760767.087702:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aee2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760767.087717:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aee2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760767.087729:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aee2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760767.087737:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627cc00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760767.087743:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aee2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760767.087755:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aee2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760767.087780:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aee2c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760767.087789:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aee2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760767.088085:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27c653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863170176:12345-192.168.203.12@tcp:4:dd.500 Request processed in 62606us (151118us total) trans 4294967493 rc 0/0 00000100:00100000:0.0:1789760767.088097:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:0.0:1789760767.088107:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 371136659728 time 371138635977 state 0x2 ref 0 00000100:00100000:2.0:1789760767.098669:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760767.098780:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863170304 00000100:00100000:0.0:1789760767.098795:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863170304 00000100:00100000:0.0:1789760767.098930:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 371136659728 time 371138635977 state 0x0 ref 1 00000100:00100000:0.0:1789760767.098958:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 371338635977 time 371138635977 state 0x1 ref 1 00010000:00010000:2.0:1789760767.185673:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760767.225683:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 371338635977 time 371338861195 state 0x0 ref 1 00000100:00100000:2.0:1789760767.225733:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d033800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863170304:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760767.225868:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 44040192, mtime: 0x6aad94fe, atime: 0x6aad94f6, ctime: 0x6aad94fe, blocks: 0x1500b 00010000:00010000:2.0:1789760767.225880:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aee33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.225899:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=371s v=(0 0) 00010000:00010000:2.0:1789760767.225905:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760767.225914:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aee33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.225932:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aee33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760767.302684:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967494 is committed 00002000:00010000:3.0:1789760767.302850:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 44040192 -> 45088768 00002000:00010000:3.0:1789760767.302857:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 86027 -> 88075 00010000:00010000:3.0:1789760767.302875:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aee33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.302890:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aee33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.302901:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aee33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.302910:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760767.302916:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aee33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.302927:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aee33 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.302956:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aee33 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.302965:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aee33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760767.303108:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d033800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863170304:12345-192.168.203.12@tcp:4:dd.500 Request processed in 77395us (204448us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1789760767.303120:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:3.0:1789760767.303162:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 371338635977 time 371338861195 state 0x2 ref 0 00000100:00100000:1.0:1789760767.316456:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760767.319952:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863170432 00000100:00100000:0.0:1789760767.319971:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863170432 00000100:00100000:0.0:1789760767.320056:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 371338635977 time 371338861195 state 0x0 ref 1 00000100:00100000:0.0:1789760767.320072:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 371538861195 time 371338861195 state 0x1 ref 1 00000100:00100000:0.0:1789760767.425781:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 371538861195 time 371538961059 state 0x0 ref 1 00000100:00100000:0.0:1789760767.425889:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ad65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863170432:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760767.425976:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 45088768, mtime: 0x6aad94fe, atime: 0x6aad94f6, ctime: 0x6aad94fe, blocks: 0x1580b 00010000:00010000:0.0:1789760767.425989:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aee3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760767.426021:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=371s v=(0 0) 00010000:00010000:0.0:1789760767.426028:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760767.426036:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aee3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760767.426074:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aee3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760767.532538:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967495 is committed 00002000:00010000:2.0:1789760767.532653:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 45088768 -> 46137344 00002000:00010000:2.0:1789760767.532659:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 88075 -> 90123 00010000:00010000:2.0:1789760767.532681:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aee3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.532698:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aee3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.532708:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aee3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.532737:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627cc00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760767.532743:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aee3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.532754:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aee3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.532778:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aee3a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.532786:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aee3a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760767.532954:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ad65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863170432:12345-192.168.203.12@tcp:4:dd.500 Request processed in 107143us (216507us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1789760767.532967:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:2.0:1789760767.532977:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 371538861195 time 371538961059 state 0x2 ref 0 00000100:00100000:1.0:1789760767.550142:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760767.550653:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863170560 00000100:00100000:3.0:1789760767.550667:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863170560 00000100:00100000:3.0:1789760767.550746:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 371538861195 time 371538961059 state 0x0 ref 1 00000100:00100000:3.0:1789760767.551024:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 371738961059 time 371538961059 state 0x1 ref 1 00000100:00100000:2.0:1789760767.568536:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df259bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883060608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760767.568642:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760767.570503:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883060608 00000100:00100000:0.0:1789760767.570525:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883060608 00000100:00100000:0.0:1789760767.570618:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789760767.570631:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d367100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876699883060608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789760767.570685:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1789760767.570861:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d367100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876699883060608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 232us (2218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760767.570869:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789760767.573623:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df259bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883060608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760767.626606:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 371738961059 time 371739784235 state 0x0 ref 1 00000100:00100000:0.0:1789760767.626655:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ad64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863170560:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760767.627289:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 46137344, mtime: 0x6aad94fe, atime: 0x6aad94f6, ctime: 0x6aad94fe, blocks: 0x1600b 00010000:00010000:0.0:1789760767.627303:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000996d94d0/0x3e099f5ef04aee41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760767.627324:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=371s v=(0 0) 00010000:00010000:0.0:1789760767.627330:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760767.627338:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000996d94d0/0x3e099f5ef04aee41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760767.627355:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000996d94d0/0x3e099f5ef04aee41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760767.699913:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967496 is committed 00002000:00010000:2.0:1789760767.700401:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 46137344 -> 47185920 00002000:00010000:2.0:1789760767.700408:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 90123 -> 92171 00010000:00010000:2.0:1789760767.700431:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000996d94d0/0x3e099f5ef04aee41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.700466:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000996d94d0/0x3e099f5ef04aee41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.700477:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000996d94d0/0x3e099f5ef04aee41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.700486:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627d800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760767.700492:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000996d94d0/0x3e099f5ef04aee41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.700502:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000996d94d0/0x3e099f5ef04aee41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.700530:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000996d94d0/0x3e099f5ef04aee41 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760767.700538:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000996d94d0/0x3e099f5ef04aee41 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760767.701250:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ad64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863170560:12345-192.168.203.12@tcp:4:dd.500 Request processed in 74398us (150909us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1789760767.701266:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:2.0:1789760767.701276:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 371738961059 time 371739784235 state 0x2 ref 0 00000100:00100000:1.0:1789760767.716397:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760767.716514:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863170688 00000100:00100000:0.0:1789760767.716528:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863170688 00000100:00100000:0.0:1789760767.716619:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 371738961059 time 371739784235 state 0x0 ref 1 00000100:00100000:0.0:1789760767.716637:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 371939784235 time 371739784235 state 0x1 ref 1 00000100:00100000:3.0:1789760767.827051:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 371939784235 time 371940229796 state 0x0 ref 1 00000100:00100000:3.0:1789760767.827100:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ad67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863170688:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760767.827359:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 47185920, mtime: 0x6aad94fe, atime: 0x6aad94f6, ctime: 0x6aad94fe, blocks: 0x1680b 00010000:00010000:3.0:1789760767.827371:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee48 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.827392:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=371s v=(0 0) 00010000:00010000:3.0:1789760767.827399:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760767.827406:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.827431:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789760767.922121:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 47185920 -> 48234496 00002000:00010000:3.0:1789760767.922142:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789760766 -> 1789760767 00002000:00010000:3.0:1789760767.922145:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789760766 -> 1789760767 00002000:00010000:3.0:1789760767.922148:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 92171 -> 94219 00010000:00010000:3.0:1789760767.922196:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.922212:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.922222:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.922229:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c5200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760767.922235:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.922246:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.922285:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee48 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760767.922293:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee48 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760767.922443:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ad67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+7:2350:x1876699863170688:12345-192.168.203.12@tcp:4:dd.500 Request processed in 95359us (206054us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1789760767.922455:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:3.0:1789760767.922466:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 371939784235 time 371940229796 state 0x2 ref 0 00000001:00080000:3.0:1789760767.922530:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967497 is committed 00000100:00100000:1.0:1789760767.930376:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760767.930557:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863170816 00000100:00100000:2.0:1789760767.930580:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863170816 00000100:00100000:2.0:1789760767.930643:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 371939784235 time 371940229796 state 0x0 ref 1 00000100:00100000:2.0:1789760767.930657:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 372140229796 time 371940229796 state 0x1 ref 1 00000100:00100000:2.0:1789760768.027279:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 372140229796 time 372140463554 state 0x0 ref 1 00000100:00100000:2.0:1789760768.027333:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ad64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863170816:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760768.027405:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 48234496, mtime: 0x6aad94ff, atime: 0x6aad94f6, ctime: 0x6aad94ff, blocks: 0x1700b 00010000:00010000:2.0:1789760768.027414:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a6c5da4/0x3e099f5ef04aee4f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760768.027430:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=372s v=(0 0) 00010000:00010000:2.0:1789760768.027434:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760768.027440:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a6c5da4/0x3e099f5ef04aee4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760768.027453:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a6c5da4/0x3e099f5ef04aee4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789760768.028509:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789760768.089699:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967498 is committed 00002000:00010000:3.0:1789760768.091727:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 48234496 -> 49283072 00002000:00010000:3.0:1789760768.091736:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 94219 -> 96267 00010000:00010000:3.0:1789760768.091843:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a6c5da4/0x3e099f5ef04aee4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.091858:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a6c5da4/0x3e099f5ef04aee4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.091866:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a6c5da4/0x3e099f5ef04aee4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.091874:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760768.091879:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a6c5da4/0x3e099f5ef04aee4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.091889:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a6c5da4/0x3e099f5ef04aee4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.091910:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a6c5da4/0x3e099f5ef04aee4f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.091918:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a6c5da4/0x3e099f5ef04aee4f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760768.092077:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ad64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863170816:12345-192.168.203.12@tcp:4:dd.500 Request processed in 64775us (161705us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1789760768.092088:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:3.0:1789760768.092109:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 372140229796 time 372140463554 state 0x2 ref 0 00000100:00100000:2.0:1789760768.101214:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760768.101845:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863170944 00000100:00100000:1.0:1789760768.101857:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863170944 00000100:00100000:1.0:1789760768.101913:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 372140229796 time 372140463554 state 0x0 ref 1 00000100:00100000:1.0:1789760768.101926:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 372340463554 time 372140463554 state 0x1 ref 1 00010000:00010000:2.0:1789760768.207230:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760768.228084:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 372340463554 time 372341269300 state 0x0 ref 1 00000100:00100000:2.0:1789760768.228119:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863170944:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760768.228193:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 49283072, mtime: 0x6aad94ff, atime: 0x6aad94f6, ctime: 0x6aad94ff, blocks: 0x1780b 00010000:00010000:2.0:1789760768.228203:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025de50ff/0x3e099f5ef04aee56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760768.228232:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=372s v=(0 0) 00010000:00010000:2.0:1789760768.228236:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760768.228242:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025de50ff/0x3e099f5ef04aee56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760768.228255:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025de50ff/0x3e099f5ef04aee56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760768.297087:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 49283072 -> 50331648 00002000:00010000:1.0:1789760768.297098:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 96267 -> 98315 00010000:00010000:1.0:1789760768.297114:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025de50ff/0x3e099f5ef04aee56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.297141:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025de50ff/0x3e099f5ef04aee56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.297151:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025de50ff/0x3e099f5ef04aee56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.297158:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760768.297163:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025de50ff/0x3e099f5ef04aee56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.297193:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025de50ff/0x3e099f5ef04aee56 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760768.297209:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967499 is committed 00010000:00010000:1.0:1789760768.297216:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025de50ff/0x3e099f5ef04aee56 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.297225:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025de50ff/0x3e099f5ef04aee56 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760768.297331:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863170944:12345-192.168.203.12@tcp:4:dd.500 Request processed in 69223us (196121us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1789760768.297342:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:1.0:1789760768.297350:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 372340463554 time 372341269300 state 0x2 ref 0 00000100:00100000:2.0:1789760768.309276:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760768.309703:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863171072 00000100:00100000:0.0:1789760768.309714:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863171072 00000100:00100000:0.0:1789760768.309774:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 372340463554 time 372341269300 state 0x0 ref 1 00000100:00100000:0.0:1789760768.309787:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 372541269300 time 372341269300 state 0x1 ref 1 00000100:00100000:3.0:1789760768.430890:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 372541269300 time 372544075961 state 0x0 ref 1 00000100:00100000:3.0:1789760768.430937:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d366a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863171072:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760768.430999:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 50331648, mtime: 0x6aad94ff, atime: 0x6aad94f6, ctime: 0x6aad94ff, blocks: 0x1800b 00010000:00010000:3.0:1789760768.431007:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee5d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.431023:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=372s v=(0 0) 00010000:00010000:3.0:1789760768.431028:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760768.431035:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.431050:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760768.487221:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967500 is committed 00002000:00010000:3.0:1789760768.487447:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 50331648 -> 51380224 00002000:00010000:3.0:1789760768.487452:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 98315 -> 100363 00010000:00010000:3.0:1789760768.487466:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.487479:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.487488:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.487509:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c5200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760768.487514:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.487524:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.487543:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee5d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.487550:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760768.487741:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d366a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863171072:12345-192.168.203.12@tcp:4:dd.500 Request processed in 56829us (178471us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1789760768.487750:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:3.0:1789760768.487757:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 372541269300 time 372544075961 state 0x2 ref 0 00000100:00100000:0.0:1789760768.493017:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760768.493437:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863171200 00000100:00100000:2.0:1789760768.493448:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863171200 00000100:00100000:2.0:1789760768.493503:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 372541269300 time 372544075961 state 0x0 ref 1 00000100:00100000:2.0:1789760768.493517:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 372744075961 time 372544075961 state 0x1 ref 1 00000100:00100000:3.0:1789760768.631069:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 372744075961 time 372744252956 state 0x0 ref 1 00000100:00100000:3.0:1789760768.631113:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863171200:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760768.631192:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 51380224, mtime: 0x6aad94ff, atime: 0x6aad94f6, ctime: 0x6aad94ff, blocks: 0x1880b 00010000:00010000:3.0:1789760768.631201:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee64 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.631239:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=372s v=(0 0) 00010000:00010000:3.0:1789760768.631243:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760768.631251:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.631265:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760768.703203:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967501 is committed 00002000:00010000:3.0:1789760768.703335:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 51380224 -> 52428800 00002000:00010000:3.0:1789760768.703351:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 100363 -> 102411 00010000:00010000:3.0:1789760768.703366:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.703379:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.703386:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.703393:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c5200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760768.703398:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.703407:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.703444:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee64 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760768.703452:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee64 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760768.703565:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863171200:12345-192.168.203.12@tcp:4:dd.500 Request processed in 72469us (210552us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1789760768.703576:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:3.0:1789760768.703585:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 372744075961 time 372744252956 state 0x2 ref 0 00000100:00100000:0.0:1789760768.711922:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760768.712160:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863171328 00000100:00100000:1.0:1789760768.712170:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863171328 00000100:00100000:1.0:1789760768.712224:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 372744075961 time 372744252956 state 0x0 ref 1 00000100:00100000:1.0:1789760768.712236:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 372944252956 time 372744252956 state 0x1 ref 1 00000100:00100000:1.0:1789760768.831115:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 372944252956 time 372944301405 state 0x0 ref 1 00000100:00100000:1.0:1789760768.831154:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863171328:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760768.831210:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 52428800, mtime: 0x6aad94ff, atime: 0x6aad94f6, ctime: 0x6aad94ff, blocks: 0x1900b 00010000:00010000:1.0:1789760768.831238:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aee6b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.831254:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=372s v=(0 0) 00010000:00010000:1.0:1789760768.831258:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760768.831265:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aee6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760768.831279:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aee6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760768.896142:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 52428800 -> 53477376 00002000:00010000:2.0:1789760768.896150:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789760767 -> 1789760768 00002000:00010000:2.0:1789760768.896152:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789760767 -> 1789760768 00002000:00010000:2.0:1789760768.896155:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 102411 -> 104459 00010000:00010000:2.0:1789760768.896168:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aee6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760768.896181:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aee6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760768.896191:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aee6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760768.896212:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861ea00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760768.896217:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aee6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760768.896227:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aee6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760768.896251:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aee6b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760768.896260:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aee6b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760768.896433:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+7:2350:x1876699863171328:12345-192.168.203.12@tcp:4:dd.500 Request processed in 65283us (184514us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1789760768.896445:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:2.0:1789760768.896453:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 372944252956 time 372944301405 state 0x2 ref 0 00000001:00080000:1.0:1789760768.897239:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967502 is committed 00000100:00100000:3.0:1789760768.901286:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760768.901549:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863171456 00000100:00100000:2.0:1789760768.901569:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863171456 00000100:00100000:2.0:1789760768.901624:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 372944252956 time 372944301405 state 0x0 ref 1 00000100:00100000:2.0:1789760768.901637:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 373144301405 time 372944301405 state 0x1 ref 1 00000100:00100000:3.0:1789760769.032463:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 373144301405 time 373145649835 state 0x0 ref 1 00000100:00100000:3.0:1789760769.032491:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863171456:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760769.032548:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 53477376, mtime: 0x6aad9500, atime: 0x6aad94f6, ctime: 0x6aad9500, blocks: 0x1980b 00010000:00010000:3.0:1789760769.032572:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.032589:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=373s v=(0 0) 00010000:00010000:3.0:1789760769.032593:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760769.032600:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.032615:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760769.078484:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 53477376 -> 54525952 00002000:00010000:1.0:1789760769.078492:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 104459 -> 106507 00010000:00010000:1.0:1789760769.078507:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.078530:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.078543:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.078551:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c5200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760769.078556:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.078585:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.078606:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee72 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.078615:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d203838f/0x3e099f5ef04aee72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760769.078716:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+7:2350:x1876699863171456:12345-192.168.203.12@tcp:4:dd.500 Request processed in 46225us (177425us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1789760769.078727:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:1.0:1789760769.078735:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 373144301405 time 373145649835 state 0x2 ref 0 00000001:00080000:2.0:1789760769.078844:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967503 is committed 00000100:00100000:2.0:1789760769.087097:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760769.087574:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863171584 00000100:00100000:3.0:1789760769.087585:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863171584 00000100:00100000:3.0:1789760769.087641:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 373144301405 time 373145649835 state 0x0 ref 1 00000100:00100000:3.0:1789760769.087654:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 373345649835 time 373145649835 state 0x1 ref 1 00010000:00010000:1.0:1789760769.231198:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760769.233481:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 373345649835 time 373346668182 state 0x0 ref 1 00000100:00100000:3.0:1789760769.233516:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d364380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863171584:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760769.233575:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 54525952, mtime: 0x6aad9500, atime: 0x6aad94f6, ctime: 0x6aad9500, blocks: 0x1a00b 00010000:00010000:3.0:1789760769.233583:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd3b4944/0x3e099f5ef04aee79 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.233599:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=373s v=(0 0) 00010000:00010000:3.0:1789760769.233604:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760769.233609:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd3b4944/0x3e099f5ef04aee79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.233622:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd3b4944/0x3e099f5ef04aee79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760769.290073:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967504 is committed 00002000:00010000:3.0:1789760769.290175:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 54525952 -> 55574528 00002000:00010000:3.0:1789760769.290179:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 106507 -> 108555 00010000:00010000:3.0:1789760769.290192:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd3b4944/0x3e099f5ef04aee79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.290230:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd3b4944/0x3e099f5ef04aee79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.290238:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd3b4944/0x3e099f5ef04aee79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.290245:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c5000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760769.290249:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd3b4944/0x3e099f5ef04aee79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.290258:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd3b4944/0x3e099f5ef04aee79 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.290277:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd3b4944/0x3e099f5ef04aee79 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.290284:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd3b4944/0x3e099f5ef04aee79 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760769.290455:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d364380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863171584:12345-192.168.203.12@tcp:4:dd.500 Request processed in 56951us (203364us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1789760769.290466:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:3.0:1789760769.290473:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 373345649835 time 373346668182 state 0x2 ref 0 00000100:00100000:2.0:1789760769.297649:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760769.298075:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863171712 00000100:00100000:3.0:1789760769.298088:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863171712 00000100:00100000:3.0:1789760769.298149:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 373345649835 time 373346668182 state 0x0 ref 1 00000100:00100000:3.0:1789760769.298162:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 373546668182 time 373346668182 state 0x1 ref 1 00000100:00100000:2.0:1789760769.435063:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 373546668182 time 373548250103 state 0x0 ref 1 00000100:00100000:2.0:1789760769.435096:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863171712:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760769.435161:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 55574528, mtime: 0x6aad9500, atime: 0x6aad94f6, ctime: 0x6aad9500, blocks: 0x1a80b 00010000:00010000:2.0:1789760769.435170:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aee80 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.435186:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=373s v=(0 0) 00010000:00010000:2.0:1789760769.435191:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760769.435198:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aee80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.435212:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aee80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760769.509567:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967505 is committed 00002000:00010000:1.0:1789760769.509777:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 55574528 -> 56623104 00002000:00010000:1.0:1789760769.509782:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 108555 -> 110603 00010000:00010000:1.0:1789760769.509798:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aee80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.509946:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aee80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.509955:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aee80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.509983:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760769.509989:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aee80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.509997:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aee80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.510017:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aee80 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.510025:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aee80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760769.510167:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863171712:12345-192.168.203.12@tcp:4:dd.500 Request processed in 75083us (212523us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1789760769.510179:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:1.0:1789760769.510187:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 373546668182 time 373548250103 state 0x2 ref 0 00000100:00100000:2.0:1789760769.518230:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760769.518637:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863171840 00000100:00100000:0.0:1789760769.518648:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863171840 00000100:00100000:0.0:1789760769.518700:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 373546668182 time 373548250103 state 0x0 ref 1 00000100:00100000:0.0:1789760769.518713:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 373748250103 time 373548250103 state 0x1 ref 1 00000100:00100000:1.0:1789760769.636085:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 373748250103 time 373749269423 state 0x0 ref 1 00000100:00100000:1.0:1789760769.636114:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d367b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863171840:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760769.636182:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 56623104, mtime: 0x6aad9500, atime: 0x6aad94f6, ctime: 0x6aad9500, blocks: 0x1b00b 00010000:00010000:1.0:1789760769.636192:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aee87 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.636222:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=373s v=(0 0) 00010000:00010000:1.0:1789760769.636226:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760769.636232:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aee87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.636247:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aee87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760769.652392:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760769.652429:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760769.652467:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760769.652494:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760769.652519:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863171968 00000100:00100000:0.0:1789760769.652528:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863171968 00000100:00100000:0.0:1789760769.652576:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 285 00000100:00100000:0.0:1789760769.652586:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2348:x1876699863171968:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1789760769.652665:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2348:x1876699863171968:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 80us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760769.652673:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 285 00000100:00100000:0.0:1789760769.652706:0:12459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863172224 00000100:00100000:0.0:1789760769.652710:0:12459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863172224 00000100:00100000:0.0:1789760769.652753:0:12459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 106 00000100:00100000:0.0:1789760769.652761:0:12459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863172224:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1789760769.652790:0:12459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863172224:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 30us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760769.652796:0:12459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 106 00000100:00080000:0.0:1789760769.652845:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789760769.652999:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863172096 00000100:00100000:1.0:1789760769.653004:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863172096 00000100:00100000:1.0:1789760769.653045:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863172352 00000100:00100000:1.0:1789760769.653048:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863172352 00000100:00100000:1.0:1789760769.653071:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 183 00000100:00100000:1.0:1789760769.653079:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+8:2348:x1876699863172096:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1789760769.653113:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+8:2348:x1876699863172096:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 35us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760769.653133:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 183 00000100:00100000:1.0:1789760769.653146:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 184 00000100:00100000:1.0:1789760769.653153:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2348:x1876699863172352:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1789760769.653177:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2348:x1876699863172352:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760769.653184:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 184 00000100:00080000:0.0:1789760769.653295:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789760769.673359:0:7658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967346 is committed 00000001:00080000:2.0:1789760769.700251:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967506 is committed 00002000:00010000:2.0:1789760769.702283:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 56623104 -> 57671680 00002000:00010000:2.0:1789760769.702291:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 110603 -> 112651 00010000:00010000:2.0:1789760769.702374:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aee87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.702388:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aee87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.702420:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aee87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.702428:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861e400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760769.702433:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aee87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.702442:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aee87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.702463:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aee87 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.702471:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000120a1357/0x3e099f5ef04aee87 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760769.702689:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d367b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863171840:12345-192.168.203.12@tcp:4:dd.500 Request processed in 66582us (184464us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1789760769.702700:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:2.0:1789760769.702707:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 373748250103 time 373749269423 state 0x2 ref 0 00000100:00100000:2.0:1789760769.717904:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760769.717987:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863172480 00000100:00100000:3.0:1789760769.717997:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863172480 00000100:00100000:3.0:1789760769.718046:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 373748250103 time 373749269423 state 0x0 ref 1 00000100:00100000:3.0:1789760769.718058:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 373949269423 time 373749269423 state 0x1 ref 1 00000100:00100000:3.0:1789760769.836208:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 373949269423 time 373949392965 state 0x0 ref 1 00000100:00100000:3.0:1789760769.836243:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d365f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863172480:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760769.836306:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 57671680, mtime: 0x6aad9500, atime: 0x6aad94f6, ctime: 0x6aad9500, blocks: 0x1b80b 00010000:00010000:3.0:1789760769.836315:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd3b4944/0x3e099f5ef04aee8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.836331:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=373s v=(0 0) 00010000:00010000:3.0:1789760769.836335:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760769.836342:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd3b4944/0x3e099f5ef04aee8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.836356:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd3b4944/0x3e099f5ef04aee8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760769.888962:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967507 is committed 00002000:00010000:1.0:1789760769.889060:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 57671680 -> 58720256 00002000:00010000:1.0:1789760769.889065:0:11799:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789760768 -> 1789760769 00002000:00010000:1.0:1789760769.889067:0:11799:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789760768 -> 1789760769 00002000:00010000:1.0:1789760769.889084:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 112651 -> 114699 00010000:00010000:1.0:1789760769.889099:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd3b4944/0x3e099f5ef04aee8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.889112:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd3b4944/0x3e099f5ef04aee8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.889134:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd3b4944/0x3e099f5ef04aee8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.889143:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c5000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760769.889148:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd3b4944/0x3e099f5ef04aee8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.889157:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd3b4944/0x3e099f5ef04aee8e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.889179:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd3b4944/0x3e099f5ef04aee8e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.889187:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd3b4944/0x3e099f5ef04aee8e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760769.889298:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d365f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863172480:12345-192.168.203.12@tcp:4:dd.500 Request processed in 53067us (171400us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1789760769.889308:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:1.0:1789760769.889315:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 373949269423 time 373949392965 state 0x2 ref 0 00000100:00100000:2.0:1789760769.897897:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760769.898015:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863172608 00000100:00100000:1.0:1789760769.898026:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863172608 00000100:00100000:1.0:1789760769.898085:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 373949269423 time 373949392965 state 0x0 ref 1 00000100:00100000:1.0:1789760769.898098:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 374149392965 time 373949392965 state 0x1 ref 1 00000100:00100000:1.0:1789760770.036284:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 374149392965 time 374149468677 state 0x0 ref 1 00000100:00100000:1.0:1789760770.036353:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d32b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863172608:12345-192.168.203.12@tcp:4:dd.500 00000100:00080000:0.0:1789760770.036469:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1789760770.036556:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 58720256, mtime: 0x6aad9501, atime: 0x6aad94f6, ctime: 0x6aad9501, blocks: 0x1c00b 00010000:00010000:1.0:1789760770.036567:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aee95 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.036582:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=374s v=(0 0) 00010000:00010000:1.0:1789760770.036587:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760770.036594:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aee95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.036609:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aee95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760770.118461:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967508 is committed 00002000:00010000:1.0:1789760770.119217:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 58720256 -> 59768832 00002000:00010000:1.0:1789760770.119222:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 114699 -> 116747 00010000:00010000:1.0:1789760770.119237:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aee95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.119252:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aee95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.119269:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aee95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.119276:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861e800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760770.119281:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aee95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.119292:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aee95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.119314:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aee95 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.119322:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aee95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760770.119437:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d32b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863172608:12345-192.168.203.12@tcp:4:dd.500 Request processed in 83117us (221546us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1789760770.119447:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:1.0:1789760770.119456:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 374149392965 time 374149468677 state 0x2 ref 0 00000100:00100000:2.0:1789760770.128874:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760770.129061:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863172736 00000100:00100000:3.0:1789760770.129071:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863172736 00000100:00100000:3.0:1789760770.129140:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 374149392965 time 374149468677 state 0x0 ref 1 00000100:00100000:3.0:1789760770.129166:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 374349468677 time 374149468677 state 0x1 ref 1 00000100:00100000:2.0:1789760770.238768:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 374349468677 time 374351942304 state 0x0 ref 1 00000100:00100000:2.0:1789760770.238842:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863172736:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760770.238909:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 59768832, mtime: 0x6aad9501, atime: 0x6aad94f6, ctime: 0x6aad9501, blocks: 0x1c80b 00010000:00010000:2.0:1789760770.238921:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04aee9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760770.238937:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=374s v=(0 0) 00010000:00010000:2.0:1789760770.238941:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760770.238947:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04aee9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760770.238962:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04aee9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760770.256494:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789760770.277069:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967509 is committed 00002000:00010000:1.0:1789760770.277182:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 59768832 -> 60817408 00002000:00010000:1.0:1789760770.277187:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 116747 -> 118795 00010000:00010000:1.0:1789760770.277200:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04aee9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.277227:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04aee9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.277233:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04aee9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.277238:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760770.277242:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04aee9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.277249:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04aee9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.277266:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04aee9c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.277270:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04aee9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760770.277362:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863172736:12345-192.168.203.12@tcp:4:dd.500 Request processed in 38571us (148495us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1789760770.277374:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 89 00000100:00100000:1.0:1789760770.277383:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 374349468677 time 374351942304 state 0x2 ref 0 00000100:00100000:2.0:1789760770.280980:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760770.281072:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863172864 00000100:00100000:3.0:1789760770.281082:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863172864 00000100:00100000:3.0:1789760770.281146:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 374349468677 time 374351942304 state 0x0 ref 1 00000100:00100000:3.0:1789760770.281159:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 374551942304 time 374351942304 state 0x1 ref 1 00000100:00100000:1.0:1789760770.440242:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 374551942304 time 374553426804 state 0x0 ref 1 00000100:00100000:1.0:1789760770.440292:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863172864:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760770.440357:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 60817408, mtime: 0x6aad9501, atime: 0x6aad94f6, ctime: 0x6aad9501, blocks: 0x1d00b 00010000:00010000:1.0:1789760770.440367:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aeea3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.440384:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=374s v=(0 0) 00010000:00010000:1.0:1789760770.440389:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760770.440395:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aeea3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.440411:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aeea3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760770.547241:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967510 is committed 00002000:00010000:1.0:1789760770.547315:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 60817408 -> 61865984 00002000:00010000:1.0:1789760770.547321:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 118795 -> 120843 00010000:00010000:1.0:1789760770.547347:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aeea3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.547361:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aeea3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.547371:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aeea3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.547378:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861e800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760770.547398:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aeea3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.547408:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aeea3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.547428:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aeea3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.547436:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aeea3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760770.547527:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863172864:12345-192.168.203.12@tcp:4:dd.500 Request processed in 107245us (266554us total) trans 4294967510 rc 0/0 00000100:00100000:1.0:1789760770.547538:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 90 00000100:00100000:1.0:1789760770.547546:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 374551942304 time 374553426804 state 0x2 ref 0 00000100:00100000:3.0:1789760770.553000:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760770.553206:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863172992 00000100:00100000:1.0:1789760770.553215:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863172992 00000100:00100000:1.0:1789760770.553272:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 374551942304 time 374553426804 state 0x0 ref 1 00000100:00100000:1.0:1789760770.553285:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 374753426804 time 374553426804 state 0x1 ref 1 00000100:00100000:2.0:1789760770.639242:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789760770.639265:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27cc7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883060736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760770.639332:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760770.639448:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883060736 00000100:00100000:3.0:1789760770.639457:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883060736 00000100:00100000:3.0:1789760770.639525:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789760770.639534:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883060736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760770.639556:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 172032000 pending 0 free 3801088000 avail 3795845120 00000100:00080000:1.0:1789760770.639657:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760770.639663:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883060736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760770.639681:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789760770.640244:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27cc7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883060736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789760770.640394:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 374753426804 time 374753585436 state 0x0 ref 1 00000100:00100000:3.0:1789760770.640413:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863172992:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760770.640459:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 61865984, mtime: 0x6aad9501, atime: 0x6aad94f6, ctime: 0x6aad9501, blocks: 0x1d80b 00010000:00010000:3.0:1789760770.640468:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008265c066/0x3e099f5ef04aeeaa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.640484:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=374s v=(0 0) 00010000:00010000:3.0:1789760770.640489:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760770.640495:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008265c066/0x3e099f5ef04aeeaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.640524:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008265c066/0x3e099f5ef04aeeaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760770.739916:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967511 is committed 00002000:00010000:2.0:1789760770.740017:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 61865984 -> 62914560 00002000:00010000:2.0:1789760770.740023:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 120843 -> 122891 00010000:00010000:2.0:1789760770.740037:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008265c066/0x3e099f5ef04aeeaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760770.740049:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008265c066/0x3e099f5ef04aeeaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760770.740072:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008265c066/0x3e099f5ef04aeeaa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760770.740079:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c4a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760770.740085:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008265c066/0x3e099f5ef04aeeaa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760770.740094:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008265c066/0x3e099f5ef04aeeaa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760770.740125:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008265c066/0x3e099f5ef04aeeaa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760770.740133:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008265c066/0x3e099f5ef04aeeaa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760770.740239:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863172992:12345-192.168.203.12@tcp:4:dd.500 Request processed in 99827us (187244us total) trans 4294967511 rc 0/0 00000100:00100000:2.0:1789760770.740249:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 91 00000100:00100000:2.0:1789760770.740257:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 374753426804 time 374753585436 state 0x2 ref 0 00000100:00100000:2.0:1789760770.747416:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760770.747659:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863173120 00000100:00100000:3.0:1789760770.747669:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863173120 00000100:00100000:3.0:1789760770.747722:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 374753426804 time 374753585436 state 0x0 ref 1 00000100:00100000:3.0:1789760770.747736:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 374953585436 time 374753585436 state 0x1 ref 1 00000100:00100000:1.0:1789760770.840570:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 374953585436 time 374953755224 state 0x0 ref 1 00000100:00100000:1.0:1789760770.840618:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df258e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863173120:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760770.840680:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 62914560, mtime: 0x6aad9501, atime: 0x6aad94f6, ctime: 0x6aad9501, blocks: 0x1e00b 00010000:00010000:1.0:1789760770.840713:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aeeb1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.840728:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=374s v=(0 0) 00010000:00010000:1.0:1789760770.840732:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760770.840738:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aeeb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760770.840752:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aeeb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760770.884419:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967512 is committed 00002000:00010000:3.0:1789760770.884496:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 62914560 -> 63963136 00002000:00010000:3.0:1789760770.884500:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789760769 -> 1789760770 00002000:00010000:3.0:1789760770.884503:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789760769 -> 1789760770 00002000:00010000:3.0:1789760770.884505:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 122891 -> 124939 00010000:00010000:3.0:1789760770.884521:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aeeb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.884534:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aeeb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.884543:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aeeb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.884551:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861e800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760770.884556:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aeeb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.884585:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aeeb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.884606:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aeeb1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760770.884614:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c73a0e0e/0x3e099f5ef04aeeb1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760770.884767:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df258e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863173120:12345-192.168.203.12@tcp:4:dd.500 Request processed in 44174us (137356us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1789760770.884778:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:3.0:1789760770.884786:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 374953585436 time 374953755224 state 0x2 ref 0 00000100:00100000:0.0:1789760770.891636:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760770.891731:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863173248 00000100:00100000:2.0:1789760770.891742:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863173248 00000100:00100000:2.0:1789760770.891843:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 374953585436 time 374953755224 state 0x0 ref 1 00000100:00100000:2.0:1789760770.891870:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 375153755224 time 374953755224 state 0x1 ref 1 00000100:00100000:1.0:1789760771.042512:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 375153755224 time 375155697340 state 0x0 ref 1 00000100:00100000:1.0:1789760771.042547:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2462f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863173248:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760771.042609:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 63963136, mtime: 0x6aad9502, atime: 0x6aad94f6, ctime: 0x6aad9502, blocks: 0x1e80b 00010000:00010000:1.0:1789760771.042619:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000278bde42/0x3e099f5ef04aeeb8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.042635:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=375s v=(0 0) 00010000:00010000:1.0:1789760771.042639:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760771.042645:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000278bde42/0x3e099f5ef04aeeb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760771.042662:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000278bde42/0x3e099f5ef04aeeb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760771.106344:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967513 is committed 00002000:00010000:2.0:1789760771.106400:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 63963136 -> 65011712 00002000:00010000:2.0:1789760771.106406:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 124939 -> 126987 00010000:00010000:2.0:1789760771.106420:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000278bde42/0x3e099f5ef04aeeb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.106432:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000278bde42/0x3e099f5ef04aeeb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.106441:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000278bde42/0x3e099f5ef04aeeb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.106449:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861fa00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760771.106454:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000278bde42/0x3e099f5ef04aeeb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.106463:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000278bde42/0x3e099f5ef04aeeb8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.106482:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000278bde42/0x3e099f5ef04aeeb8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.106491:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000278bde42/0x3e099f5ef04aeeb8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760771.106588:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2462f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863173248:12345-192.168.203.12@tcp:4:dd.500 Request processed in 64054us (214958us total) trans 4294967513 rc 0/0 00000100:00100000:2.0:1789760771.106610:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:2.0:1789760771.106617:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 375153755224 time 375155697340 state 0x2 ref 0 00000100:00100000:3.0:1789760771.119300:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760771.119408:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863173376 00000100:00100000:1.0:1789760771.119432:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863173376 00000100:00100000:1.0:1789760771.119484:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 375153755224 time 375155697340 state 0x0 ref 1 00000100:00100000:1.0:1789760771.119497:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 375355697340 time 375155697340 state 0x1 ref 1 00000100:00100000:2.0:1789760771.243082:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 375355697340 time 375356268099 state 0x0 ref 1 00000100:00100000:2.0:1789760771.243134:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cc7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863173376:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760771.243192:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 65011712, mtime: 0x6aad9502, atime: 0x6aad94f6, ctime: 0x6aad9502, blocks: 0x1f00b 00010000:00010000:2.0:1789760771.243202:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ead603cd/0x3e099f5ef04aeebf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.243218:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=375s v=(0 0) 00010000:00010000:2.0:1789760771.243222:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760771.243228:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ead603cd/0x3e099f5ef04aeebf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.243242:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ead603cd/0x3e099f5ef04aeebf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.280822:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789760771.318134:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967514 is committed 00002000:00010000:2.0:1789760771.318417:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 65011712 -> 66060288 00002000:00010000:2.0:1789760771.318422:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 126987 -> 129035 00010000:00010000:2.0:1789760771.318436:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ead603cd/0x3e099f5ef04aeebf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.318449:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ead603cd/0x3e099f5ef04aeebf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.318477:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ead603cd/0x3e099f5ef04aeebf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.318484:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760771.318489:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ead603cd/0x3e099f5ef04aeebf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.318499:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ead603cd/0x3e099f5ef04aeebf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.318520:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ead603cd/0x3e099f5ef04aeebf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.318528:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ead603cd/0x3e099f5ef04aeebf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760771.318627:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cc7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863173376:12345-192.168.203.12@tcp:4:dd.500 Request processed in 75505us (199331us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1789760771.318637:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:2.0:1789760771.318646:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 375355697340 time 375356268099 state 0x2 ref 0 00000100:00100000:2.0:1789760771.324752:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760771.324844:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863173504 00000100:00100000:3.0:1789760771.324854:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863173504 00000100:00100000:3.0:1789760771.324908:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 375355697340 time 375356268099 state 0x0 ref 1 00000100:00100000:3.0:1789760771.324921:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 375556268099 time 375356268099 state 0x1 ref 1 00000100:00100000:3.0:1789760771.445027:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 375556268099 time 375558211361 state 0x0 ref 1 00000100:00100000:3.0:1789760771.445063:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25957d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863173504:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760771.445141:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 66060288, mtime: 0x6aad9502, atime: 0x6aad94f6, ctime: 0x6aad9502, blocks: 0x1f80b 00010000:00010000:3.0:1789760771.445152:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077341bf4/0x3e099f5ef04aeec6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.445183:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=375s v=(0 0) 00010000:00010000:3.0:1789760771.445187:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760771.445195:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077341bf4/0x3e099f5ef04aeec6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760771.445210:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077341bf4/0x3e099f5ef04aeec6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760771.512387:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967515 is committed 00002000:00010000:0.0:1789760771.512558:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 66060288 -> 67108864 00002000:00010000:0.0:1789760771.512563:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 129035 -> 131083 00010000:00010000:0.0:1789760771.512767:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077341bf4/0x3e099f5ef04aeec6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.512782:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077341bf4/0x3e099f5ef04aeec6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.512838:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077341bf4/0x3e099f5ef04aeec6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.512847:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c5400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760771.512852:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077341bf4/0x3e099f5ef04aeec6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.512861:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077341bf4/0x3e099f5ef04aeec6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.512881:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077341bf4/0x3e099f5ef04aeec6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760771.512889:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077341bf4/0x3e099f5ef04aeec6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760771.512992:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25957d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863173504:12345-192.168.203.12@tcp:4:dd.500 Request processed in 67941us (188244us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1789760771.513003:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:0.0:1789760771.513012:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 375556268099 time 375558211361 state 0x2 ref 0 00000100:00100000:2.0:1789760771.521784:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760771.522215:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863173632 00000100:00100000:0.0:1789760771.522227:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863173632 00000100:00100000:0.0:1789760771.522279:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 375556268099 time 375558211361 state 0x0 ref 1 00000100:00100000:0.0:1789760771.522293:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 375758211361 time 375558211361 state 0x1 ref 1 00000100:00100000:2.0:1789760771.646609:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 375758211361 time 375759795259 state 0x0 ref 1 00000100:00100000:2.0:1789760771.646920:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25957ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863173632:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760771.646984:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 67108864, mtime: 0x6aad9502, atime: 0x6aad94f6, ctime: 0x6aad9502, blocks: 0x2000b 00010000:00010000:2.0:1789760771.646993:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04aeecd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.647010:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=375s v=(0 0) 00010000:00010000:2.0:1789760771.647014:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760771.647020:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04aeecd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.647035:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04aeecd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760771.687359:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967516 is committed 00002000:00010000:2.0:1789760771.687552:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 67108864 -> 68157440 00002000:00010000:2.0:1789760771.687557:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 131083 -> 133131 00010000:00010000:2.0:1789760771.687571:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04aeecd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.687584:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04aeecd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.687593:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04aeecd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.687601:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760771.687606:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04aeecd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.687630:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04aeecd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.687651:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04aeecd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.687660:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04aeecd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760771.687765:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25957ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863173632:12345-192.168.203.12@tcp:4:dd.500 Request processed in 41116us (165989us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1789760771.687773:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 96 00000100:00100000:2.0:1789760771.687779:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 375758211361 time 375759795259 state 0x2 ref 0 00000100:00100000:3.0:1789760771.693687:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760771.694039:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863173760 00000100:00100000:1.0:1789760771.694050:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863173760 00000100:00100000:1.0:1789760771.694123:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 375758211361 time 375759795259 state 0x0 ref 1 00000100:00100000:1.0:1789760771.694138:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 375959795259 time 375759795259 state 0x1 ref 1 00000100:00100000:2.0:1789760771.847009:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 375959795259 time 375960193508 state 0x0 ref 1 00000100:00100000:2.0:1789760771.847044:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27cd8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863173760:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760771.847108:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 68157440, mtime: 0x6aad9502, atime: 0x6aad94f6, ctime: 0x6aad9502, blocks: 0x2080b 00010000:00010000:2.0:1789760771.847118:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04aeed4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.847134:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=375s v=(0 0) 00010000:00010000:2.0:1789760771.847138:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760771.847145:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04aeed4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.847178:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04aeed4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760771.907307:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967517 is committed 00002000:00010000:2.0:1789760771.907443:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 68157440 -> 69206016 00002000:00010000:2.0:1789760771.907448:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789760770 -> 1789760771 00002000:00010000:2.0:1789760771.907450:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789760770 -> 1789760771 00002000:00010000:2.0:1789760771.907453:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 133131 -> 135179 00010000:00010000:2.0:1789760771.907466:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04aeed4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.907478:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04aeed4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.907488:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04aeed4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.907495:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760771.907500:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04aeed4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.907509:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04aeed4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.907531:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04aeed4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760771.907559:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04aeed4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760771.907656:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27cd8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863173760:12345-192.168.203.12@tcp:4:dd.500 Request processed in 60625us (213976us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1789760771.907666:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:2.0:1789760771.907673:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 375959795259 time 375960193508 state 0x2 ref 0 00000100:00100000:0.0:1789760771.922057:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760771.925694:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863173888 00000100:00100000:3.0:1789760771.925711:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863173888 00000100:00100000:1.0:1789760771.928433:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 375959795259 time 375960193508 state 0x0 ref 1 00000100:00100000:1.0:1789760771.928449:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 376160193508 time 375960193508 state 0x1 ref 1 00000100:00100000:0.0:1789760772.049303:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 376160193508 time 376162487802 state 0x0 ref 1 00000100:00100000:0.0:1789760772.049368:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2462f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863173888:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760772.049429:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 69206016, mtime: 0x6aad9503, atime: 0x6aad94f6, ctime: 0x6aad9503, blocks: 0x2100b 00010000:00010000:0.0:1789760772.049439:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6058422/0x3e099f5ef04aeedb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.049457:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=376s v=(0 0) 00010000:00010000:0.0:1789760772.049461:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.049467:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6058422/0x3e099f5ef04aeedb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.049482:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6058422/0x3e099f5ef04aeedb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789760772.050520:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1789760772.106656:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 69206016 -> 70254592 00002000:00010000:0.0:1789760772.106665:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 135179 -> 137229 00010000:00010000:0.0:1789760772.106680:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6058422/0x3e099f5ef04aeedb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.106691:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6058422/0x3e099f5ef04aeedb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.106699:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6058422/0x3e099f5ef04aeedb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.106721:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627da00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760772.106726:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6058422/0x3e099f5ef04aeedb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.106795:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6058422/0x3e099f5ef04aeedb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.106847:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6058422/0x3e099f5ef04aeedb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.106855:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6058422/0x3e099f5ef04aeedb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.106946:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2462f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+7:2348:x1876699863173888:12345-192.168.203.12@tcp:4:dd.500 Request processed in 57614us (184892us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1789760772.106957:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:0.0:1789760772.106966:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 376160193508 time 376162487802 state 0x2 ref 0 00000001:00080000:3.0:1789760772.107130:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967518 is committed 00000100:00100000:2.0:1789760772.118514:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760772.121170:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863174016 00000100:00100000:0.0:1789760772.121187:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863174016 00000100:00100000:0.0:1789760772.121247:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 376160193508 time 376162487802 state 0x0 ref 1 00000100:00100000:0.0:1789760772.121261:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 376362487802 time 376162487802 state 0x1 ref 1 00000100:00100000:0.0:1789760772.175308:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df24626f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883061120:0@lo:400:kworker.0 00000100:00100000:0.0:1789760772.175395:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760772.175467:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789760772.175474:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df24626fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883061248:0@lo:400:kworker.0 00000100:00100000:0.0:1789760772.175498:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760772.175533:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883061248 00000100:00100000:0.0:1789760772.175539:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883061248 00000100:00100000:0.0:1789760772.175592:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789760772.175600:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df244d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883061248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760772.175644:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df244d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883061248:12345-0@lo:400:kworker.0 Request processed in 44us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760772.175650:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789760772.175686:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df24626fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883061248:0@lo:400:kworker.0 00000100:00100000:0.0:1789760772.175715:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883061120 00000100:00100000:0.0:1789760772.175717:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883061120 00000100:00080000:1.0:1789760772.177918:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789760772.177929:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760772.178514:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789760772.178533:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df244d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883061120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760772.178628:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df244d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883061120:12345-0@lo:400:kworker.0 Request processed in 105us (3233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760772.178636:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789760772.178689:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df24626f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883061120:0@lo:400:kworker.0 00000100:00100000:3.0:1789760772.178840:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d1a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883060992:0@lo:400:kworker.0 00000100:00100000:3.0:1789760772.178881:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760772.178917:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df24626dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883061504:0@lo:400:kworker.0 00000100:00100000:3.0:1789760772.178942:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760772.178976:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789760772.178982:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df14ad64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699883060864:0@lo:400:kworker.0 00000100:00100000:3.0:1789760772.179004:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760772.179023:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df24626e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1876699883061376:0@lo:400:kworker.0 00000100:00100000:3.0:1789760772.179041:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760772.179064:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883060992 00000100:00100000:3.0:1789760772.179069:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883060992 00000100:00100000:3.0:1789760772.179094:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883061376 00000100:00100000:3.0:1789760772.179860:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883061376 00000100:00100000:3.0:1789760772.179907:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789760772.179914:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883060992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760772.179961:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883060992:12345-0@lo:400:kworker.0 Request processed in 48us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760772.179967:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789760772.179985:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789760772.179991:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876699883061376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760772.180013:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876699883061376:12345-0@lo:400:kworker.0 Request processed in 23us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760772.180018:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789760772.180037:0:12460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883061504 00000100:00100000:3.0:1789760772.180040:0:12460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883061504 00000100:00100000:3.0:1789760772.180069:0:12460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789760772.180075:0:12460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2747f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883061504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760772.180116:0:12460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2747f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883061504:12345-0@lo:400:kworker.0 Request processed in 40us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760772.180120:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883060864 00000100:00100000:3.0:1789760772.180125:0:12460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789760772.180127:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883060864 00000100:00100000:2.0:1789760772.180162:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1789760772.180169:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df24626e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1876699883061376:0@lo:400:kworker.0 00000100:00100000:2.0:1789760772.180171:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:3311:x1876699883060864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760772.180187:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d1a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883060992:0@lo:400:kworker.0 00000100:00100000:3.0:1789760772.180198:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967346 gen 2 00000100:00100000:2.0:1789760772.180215:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:3311:x1876699883060864:12345-0@lo:400:kworker.0 Request processed in 46us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760772.180222:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000004:00080000:3.0:1789760772.180383:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8df14ad64000, transno 4294967346 00000100:00100000:3.0:1789760772.180400:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df24626dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883061504:0@lo:400:kworker.0 00000100:00100000:3.0:1789760772.180453:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df14ad64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699883060864:0@lo:400:kworker.0 00000100:00080000:0.0:1789760772.181225:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789760772.181230:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760772.250239:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 376362487802 time 376363425523 state 0x0 ref 1 00000100:00100000:2.0:1789760772.250275:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25957f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863174016:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760772.250334:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 70254592, mtime: 0x6aad9503, atime: 0x6aad94f6, ctime: 0x6aad9503, blocks: 0x2180d 00010000:00010000:2.0:1789760772.250344:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aeee2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.250361:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=376s v=(0 0) 00010000:00010000:2.0:1789760772.250366:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760772.250388:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aeee2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.250404:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aeee2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.304827:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789760772.316476:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967519 is committed 00002000:00010000:2.0:1789760772.316743:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 70254592 -> 71303168 00002000:00010000:2.0:1789760772.316748:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 137229 -> 139277 00010000:00010000:2.0:1789760772.316763:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aeee2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.316776:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aeee2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.316785:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aeee2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.316793:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760772.316797:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aeee2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.316831:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aeee2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.316850:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aeee2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.316877:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aeee2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760772.316977:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25957f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863174016:12345-192.168.203.12@tcp:4:dd.500 Request processed in 66714us (198466us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1789760772.316987:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 99 00000100:00100000:2.0:1789760772.316995:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 376362487802 time 376363425523 state 0x2 ref 0 00000100:00100000:0.0:1789760772.322144:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760772.322442:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863174144 00000100:00100000:1.0:1789760772.322454:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863174144 00000100:00100000:1.0:1789760772.322508:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 376362487802 time 376363425523 state 0x0 ref 1 00000100:00100000:1.0:1789760772.322521:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 376563425523 time 376363425523 state 0x1 ref 1 00000100:00100000:2.0:1789760772.450460:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 376563425523 time 376563645217 state 0x0 ref 1 00000100:00100000:2.0:1789760772.450618:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df244d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863174144:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760772.450679:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 71303168, mtime: 0x6aad9503, atime: 0x6aad94f6, ctime: 0x6aad9503, blocks: 0x2200d 00010000:00010000:2.0:1789760772.450692:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aeee9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.450718:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=376s v=(0 0) 00010000:00010000:2.0:1789760772.450723:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760772.450729:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aeee9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.450893:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aeee9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760772.509643:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967520 is committed 00002000:00010000:1.0:1789760772.510292:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 71303168 -> 72351744 00002000:00010000:1.0:1789760772.510298:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 139277 -> 141325 00010000:00010000:1.0:1789760772.510348:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aeee9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.510363:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aeee9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.510396:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aeee9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.510405:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760772.510410:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aeee9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.510420:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aeee9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.510440:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aeee9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.510448:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6b3528e/0x3e099f5ef04aeee9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760772.510553:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df244d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863174144:12345-192.168.203.12@tcp:4:dd.500 Request processed in 60070us (188414us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1789760772.510563:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:1.0:1789760772.510570:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 376563425523 time 376563645217 state 0x2 ref 0 00000100:00100000:0.0:1789760772.520986:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760772.521494:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863174272 00000100:00100000:1.0:1789760772.521503:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863174272 00000100:00100000:1.0:1789760772.521557:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 376563425523 time 376563645217 state 0x0 ref 1 00000100:00100000:1.0:1789760772.521570:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 376763645217 time 376563645217 state 0x1 ref 1 00000100:00100000:0.0:1789760772.650974:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 376763645217 time 376764158573 state 0x0 ref 1 00000100:00100000:0.0:1789760772.651009:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df244d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863174272:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760772.651083:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 72351744, mtime: 0x6aad9503, atime: 0x6aad94f6, ctime: 0x6aad9503, blocks: 0x2280d 00010000:00010000:0.0:1789760772.651092:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aeef0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.651120:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=376s v=(0 0) 00010000:00010000:0.0:1789760772.651124:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760772.651139:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aeef0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760772.651383:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aeef0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760772.687562:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789760772.687582:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df244d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883061632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760772.687647:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760772.688232:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883061632 00000100:00100000:1.0:1789760772.688241:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883061632 00000100:00100000:1.0:1789760772.688304:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789760772.688313:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df244d0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883061632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789760772.688344:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 71499776 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760772.688402:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df244d0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883061632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760772.688409:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789760772.688509:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df244d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883061632:0@lo:13:osp-pre-1-0.0 00002000:00010000:1.0:1789760772.735032:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 72351744 -> 73400320 00002000:00010000:1.0:1789760772.735041:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 141325 -> 143373 00010000:00010000:1.0:1789760772.735057:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aeef0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.735071:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aeef0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.735081:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aeef0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.735088:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627cc00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760772.735102:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aeef0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.735112:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aeef0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.735131:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aeef0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760772.735152:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c458bcdf/0x3e099f5ef04aeef0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760772.735241:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df244d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+7:2348:x1876699863174272:12345-192.168.203.12@tcp:4:dd.500 Request processed in 84245us (214259us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1789760772.735250:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 101 00000100:00100000:1.0:1789760772.735258:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 376763645217 time 376764158573 state 0x2 ref 0 00000001:00080000:2.0:1789760772.737329:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967521 is committed 00000100:00100000:1.0:1789760772.739164:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760772.739432:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863174400 00000100:00100000:3.0:1789760772.739456:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863174400 00000100:00100000:3.0:1789760772.739509:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 376763645217 time 376764158573 state 0x0 ref 1 00000100:00100000:3.0:1789760772.739521:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 376964158573 time 376764158573 state 0x1 ref 1 00000100:00100000:2.0:1789760772.851359:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 376964158573 time 376964544591 state 0x0 ref 1 00000100:00100000:2.0:1789760772.851392:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24626d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863174400:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760772.851448:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 73400320, mtime: 0x6aad9503, atime: 0x6aad94f6, ctime: 0x6aad9503, blocks: 0x2300d 00010000:00010000:2.0:1789760772.851457:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3f50fff/0x3e099f5ef04aeef7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.851473:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=376s v=(0 0) 00010000:00010000:2.0:1789760772.851478:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760772.851485:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3f50fff/0x3e099f5ef04aeef7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760772.851498:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3f50fff/0x3e099f5ef04aeef7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760772.912579:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967522 is committed 00002000:00010000:3.0:1789760772.912867:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 73400320 -> 74448896 00002000:00010000:3.0:1789760772.912871:0:11799:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789760771 -> 1789760772 00002000:00010000:3.0:1789760772.912874:0:11799:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789760771 -> 1789760772 00002000:00010000:3.0:1789760772.912877:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 143373 -> 145421 00010000:00010000:3.0:1789760772.912890:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3f50fff/0x3e099f5ef04aeef7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.912904:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3f50fff/0x3e099f5ef04aeef7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.912913:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3f50fff/0x3e099f5ef04aeef7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.912920:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760772.912925:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3f50fff/0x3e099f5ef04aeef7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.912934:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3f50fff/0x3e099f5ef04aeef7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.912954:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3f50fff/0x3e099f5ef04aeef7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760772.912980:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3f50fff/0x3e099f5ef04aeef7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760772.913078:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24626d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863174400:12345-192.168.203.12@tcp:4:dd.500 Request processed in 61698us (173916us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1789760772.913087:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 102 00000100:00100000:3.0:1789760772.913105:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 376964158573 time 376964544591 state 0x2 ref 0 00000100:00100000:2.0:1789760772.919899:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760772.920204:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863174528 00000100:00100000:1.0:1789760772.920214:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863174528 00000100:00100000:2.0:1789760772.920344:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 376964158573 time 376964544591 state 0x0 ref 1 00000100:00100000:2.0:1789760772.920358:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 377164544591 time 376964544591 state 0x1 ref 1 00000100:00100000:1.0:1789760773.052142:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 377164544591 time 377165328403 state 0x0 ref 1 00000100:00100000:1.0:1789760773.052185:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25957c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863174528:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760773.052246:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 74448896, mtime: 0x6aad9504, atime: 0x6aad94f6, ctime: 0x6aad9504, blocks: 0x2380d 00010000:00010000:1.0:1789760773.052255:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077188a43/0x3e099f5ef04aeefe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.052271:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=377s v=(0 0) 00010000:00010000:1.0:1789760773.052276:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760773.052282:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077188a43/0x3e099f5ef04aeefe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.052297:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077188a43/0x3e099f5ef04aeefe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760773.116702:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 74448896 -> 75497472 00002000:00010000:1.0:1789760773.116712:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 145421 -> 147469 00010000:00010000:1.0:1789760773.116728:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077188a43/0x3e099f5ef04aeefe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.116740:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077188a43/0x3e099f5ef04aeefe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.116749:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077188a43/0x3e099f5ef04aeefe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.116757:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861ec00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760773.116762:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077188a43/0x3e099f5ef04aeefe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.116770:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077188a43/0x3e099f5ef04aeefe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.116790:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077188a43/0x3e099f5ef04aeefe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.116796:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077188a43/0x3e099f5ef04aeefe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760773.116927:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25957c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+7:2351:x1876699863174528:12345-192.168.203.12@tcp:4:dd.500 Request processed in 64753us (197034us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1789760773.116952:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 103 00000100:00100000:1.0:1789760773.116961:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 377164544591 time 377165328403 state 0x2 ref 0 00000001:00080000:0.0:1789760773.117629:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967523 is committed 00000100:00100000:2.0:1789760773.124446:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760773.124543:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863174656 00000100:00100000:1.0:1789760773.124553:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863174656 00000100:00100000:1.0:1789760773.124608:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 377164544591 time 377165328403 state 0x0 ref 1 00000100:00100000:1.0:1789760773.124621:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 377365328403 time 377165328403 state 0x1 ref 1 00000100:00100000:1.0:1789760773.252256:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 377365328403 time 377365442119 state 0x0 ref 1 00000100:00100000:1.0:1789760773.252288:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25957ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863174656:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760773.252352:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 75497472, mtime: 0x6aad9504, atime: 0x6aad94f6, ctime: 0x6aad9504, blocks: 0x2400d 00010000:00010000:1.0:1789760773.252360:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077188a43/0x3e099f5ef04aef05 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.252378:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=377s v=(0 0) 00010000:00010000:1.0:1789760773.252383:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760773.252391:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077188a43/0x3e099f5ef04aef05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.252406:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077188a43/0x3e099f5ef04aef05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760773.305569:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967524 is committed 00002000:00010000:3.0:1789760773.305728:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 75497472 -> 76546048 00002000:00010000:3.0:1789760773.305733:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 147469 -> 149517 00010000:00010000:3.0:1789760773.305748:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077188a43/0x3e099f5ef04aef05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.305762:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077188a43/0x3e099f5ef04aef05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.305771:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077188a43/0x3e099f5ef04aef05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.305777:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861ec00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760773.305782:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077188a43/0x3e099f5ef04aef05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.305791:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077188a43/0x3e099f5ef04aef05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.305861:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077188a43/0x3e099f5ef04aef05 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.305869:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077188a43/0x3e099f5ef04aef05 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760773.305959:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25957ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863174656:12345-192.168.203.12@tcp:4:dd.500 Request processed in 53682us (181516us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1789760773.305984:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:3.0:1789760773.305992:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 377365328403 time 377365442119 state 0x2 ref 0 00000100:00100000:0.0:1789760773.312475:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760773.312599:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863174784 00000100:00100000:3.0:1789760773.312609:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863174784 00000100:00100000:3.0:1789760773.312753:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 377365328403 time 377365442119 state 0x0 ref 1 00000100:00100000:3.0:1789760773.312767:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 377565442119 time 377365442119 state 0x1 ref 1 00010000:00010000:0.0:1789760773.328372:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760773.452536:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 377565442119 time 377565721224 state 0x0 ref 1 00000100:00100000:3.0:1789760773.452569:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df244d0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863174784:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760773.452631:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 76546048, mtime: 0x6aad9504, atime: 0x6aad94f6, ctime: 0x6aad9504, blocks: 0x2480d 00010000:00010000:3.0:1789760773.452640:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009683602f/0x3e099f5ef04aef0c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.452656:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=377s v=(0 0) 00010000:00010000:3.0:1789760773.452660:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760773.452692:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009683602f/0x3e099f5ef04aef0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.452708:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009683602f/0x3e099f5ef04aef0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760773.528497:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 76546048 -> 77594624 00002000:00010000:2.0:1789760773.528512:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 149517 -> 151565 00010000:00010000:2.0:1789760773.528531:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009683602f/0x3e099f5ef04aef0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.528572:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009683602f/0x3e099f5ef04aef0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.528582:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009683602f/0x3e099f5ef04aef0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.528590:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c5c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760773.528596:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009683602f/0x3e099f5ef04aef0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.528607:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009683602f/0x3e099f5ef04aef0c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.528634:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009683602f/0x3e099f5ef04aef0c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.528642:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009683602f/0x3e099f5ef04aef0c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760773.528784:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df244d0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+7:2348:x1876699863174784:12345-192.168.203.12@tcp:4:dd.500 Request processed in 76223us (216310us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1789760773.528797:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 105 00000100:00100000:2.0:1789760773.528846:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 377565442119 time 377565721224 state 0x2 ref 0 00000001:00080000:0.0:1789760773.530927:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967525 is committed 00000100:00100000:0.0:1789760773.535755:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760773.535944:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863174912 00000100:00100000:1.0:1789760773.535959:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863174912 00000100:00100000:1.0:1789760773.536176:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 377565442119 time 377565721224 state 0x0 ref 1 00000100:00100000:1.0:1789760773.536204:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 377765721224 time 377565721224 state 0x1 ref 1 00000100:00100000:1.0:1789760773.652731:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 377765721224 time 377765908423 state 0x0 ref 1 00000100:00100000:1.0:1789760773.652784:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df244d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863174912:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760773.652999:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 77594624, mtime: 0x6aad9504, atime: 0x6aad94f6, ctime: 0x6aad9504, blocks: 0x2500d 00010000:00010000:1.0:1789760773.653011:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1ddc006/0x3e099f5ef04aef13 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.653031:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=377s v=(0 0) 00010000:00010000:1.0:1789760773.653036:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760773.653044:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1ddc006/0x3e099f5ef04aef13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.653062:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1ddc006/0x3e099f5ef04aef13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760773.711013:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 77594624 -> 78643200 00002000:00010000:2.0:1789760773.711038:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 151565 -> 153613 00010000:00010000:2.0:1789760773.711058:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1ddc006/0x3e099f5ef04aef13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.711072:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1ddc006/0x3e099f5ef04aef13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.711081:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1ddc006/0x3e099f5ef04aef13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.711098:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861fe00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760773.711103:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1ddc006/0x3e099f5ef04aef13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.711113:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1ddc006/0x3e099f5ef04aef13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.711133:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1ddc006/0x3e099f5ef04aef13 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760773.711141:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1ddc006/0x3e099f5ef04aef13 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760773.711262:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df244d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+7:2348:x1876699863174912:12345-192.168.203.12@tcp:4:dd.500 Request processed in 58500us (175516us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1789760773.711273:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 106 00000100:00100000:2.0:1789760773.711283:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 377765721224 time 377765908423 state 0x2 ref 0 00000001:00080000:3.0:1789760773.712238:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967526 is committed 00000100:00100000:0.0:1789760773.721104:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760773.722127:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863175040 00000100:00100000:1.0:1789760773.722149:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863175040 00000100:00100000:1.0:1789760773.722281:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 377765721224 time 377765908423 state 0x0 ref 1 00000100:00100000:1.0:1789760773.722296:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 377965908423 time 377765908423 state 0x1 ref 1 00000100:00100000:3.0:1789760773.852904:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 377965908423 time 377966090099 state 0x0 ref 1 00000100:00100000:3.0:1789760773.852937:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df244d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863175040:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760773.852996:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 78643200, mtime: 0x6aad9504, atime: 0x6aad94f6, ctime: 0x6aad9504, blocks: 0x2580d 00010000:00010000:3.0:1789760773.853004:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c39edfe/0x3e099f5ef04aef1a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.853021:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=377s v=(0 0) 00010000:00010000:3.0:1789760773.853025:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760773.853031:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c39edfe/0x3e099f5ef04aef1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.853045:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c39edfe/0x3e099f5ef04aef1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760773.911445:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967527 is committed 00002000:00010000:3.0:1789760773.911485:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 78643200 -> 79691776 00002000:00010000:3.0:1789760773.911490:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789760772 -> 1789760773 00002000:00010000:3.0:1789760773.911492:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789760772 -> 1789760773 00002000:00010000:3.0:1789760773.911495:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 153613 -> 155661 00010000:00010000:3.0:1789760773.911508:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c39edfe/0x3e099f5ef04aef1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.911553:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c39edfe/0x3e099f5ef04aef1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.911561:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c39edfe/0x3e099f5ef04aef1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.911569:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c5600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760773.911573:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c39edfe/0x3e099f5ef04aef1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.911583:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c39edfe/0x3e099f5ef04aef1a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.911607:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c39edfe/0x3e099f5ef04aef1a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.911615:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c39edfe/0x3e099f5ef04aef1a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760773.911715:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df244d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863175040:12345-192.168.203.12@tcp:4:dd.500 Request processed in 58789us (190626us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1789760773.911725:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 107 00000100:00100000:3.0:1789760773.911732:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 377965908423 time 377966090099 state 0x2 ref 0 00000100:00100000:3.0:1789760773.922274:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760773.922387:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863175168 00000100:00100000:0.0:1789760773.922398:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863175168 00000100:00100000:0.0:1789760773.922452:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 377965908423 time 377966090099 state 0x0 ref 1 00000100:00100000:0.0:1789760773.922463:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 378166090099 time 377966090099 state 0x1 ref 1 00000100:00100000:2.0:1789760774.054529:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 378166090099 time 378167713423 state 0x0 ref 1 00000100:00100000:2.0:1789760774.054573:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ad64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863175168:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760774.054641:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 79691776, mtime: 0x6aad9505, atime: 0x6aad94f6, ctime: 0x6aad9505, blocks: 0x2600d 00010000:00010000:2.0:1789760774.054650:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aef21 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789760774.054786:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789760774.055103:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=378s v=(0 0) 00010000:00010000:2.0:1789760774.055110:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760774.055117:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aef21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.055133:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aef21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760774.122411:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967528 is committed 00002000:00010000:2.0:1789760774.122682:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 79691776 -> 80740352 00002000:00010000:2.0:1789760774.122688:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 155661 -> 157709 00010000:00010000:2.0:1789760774.122707:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aef21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.122723:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aef21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.122732:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aef21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.122763:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760774.122769:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aef21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.122780:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aef21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.122951:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aef21 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.122961:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aef21 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760774.123199:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ad64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863175168:12345-192.168.203.12@tcp:4:dd.500 Request processed in 68645us (200934us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1789760774.123214:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 108 00000100:00100000:2.0:1789760774.123225:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 378166090099 time 378167713423 state 0x2 ref 0 00000100:00100000:0.0:1789760774.132074:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760774.132276:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863175296 00000100:00100000:1.0:1789760774.132290:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863175296 00000100:00100000:1.0:1789760774.132366:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 378166090099 time 378167713423 state 0x0 ref 1 00000100:00100000:1.0:1789760774.132382:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 378367713423 time 378167713423 state 0x1 ref 1 00000100:00100000:2.0:1789760774.258404:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 378367713423 time 378371573599 state 0x0 ref 1 00000100:00100000:2.0:1789760774.258450:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863175296:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760774.258530:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 80740352, mtime: 0x6aad9505, atime: 0x6aad94f6, ctime: 0x6aad9505, blocks: 0x2680d 00010000:00010000:2.0:1789760774.258542:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aef28 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.258586:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=378s v=(0 0) 00010000:00010000:2.0:1789760774.258592:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760774.258599:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aef28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.258615:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aef28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760774.321637:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967529 is committed 00002000:00010000:2.0:1789760774.321775:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 80740352 -> 81788928 00002000:00010000:2.0:1789760774.321782:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 157709 -> 159757 00010000:00010000:2.0:1789760774.321873:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aef28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.321891:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aef28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.321902:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aef28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.321910:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760774.321915:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aef28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.321926:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aef28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.321972:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aef28 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.321981:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aef28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760774.322172:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863175296:12345-192.168.203.12@tcp:4:dd.500 Request processed in 63740us (190367us total) trans 4294967529 rc 0/0 00000100:00100000:2.0:1789760774.322183:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 109 00000100:00100000:2.0:1789760774.322193:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 378367713423 time 378371573599 state 0x2 ref 0 00000100:00100000:3.0:1789760774.329005:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760774.329958:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863175424 00000100:00100000:1.0:1789760774.329974:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863175424 00000100:00100000:1.0:1789760774.330053:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 378367713423 time 378371573599 state 0x0 ref 1 00000100:00100000:1.0:1789760774.330070:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 378571573599 time 378371573599 state 0x1 ref 1 00010000:00010000:2.0:1789760774.351112:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760774.458715:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 378571573599 time 378571894400 state 0x0 ref 1 00000100:00100000:3.0:1789760774.458762:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df14ad64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863175424:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760774.459008:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 81788928, mtime: 0x6aad9505, atime: 0x6aad94f6, ctime: 0x6aad9505, blocks: 0x2700d 00010000:00010000:3.0:1789760774.459019:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c39edfe/0x3e099f5ef04aef2f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.459277:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=378s v=(0 0) 00010000:00010000:3.0:1789760774.459285:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760774.459293:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c39edfe/0x3e099f5ef04aef2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760774.459312:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c39edfe/0x3e099f5ef04aef2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760774.538046:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967530 is committed 00002000:00010000:1.0:1789760774.538167:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 81788928 -> 82837504 00002000:00010000:1.0:1789760774.538173:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 159757 -> 161805 00010000:00010000:1.0:1789760774.538191:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c39edfe/0x3e099f5ef04aef2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.538206:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c39edfe/0x3e099f5ef04aef2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.538216:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c39edfe/0x3e099f5ef04aef2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.538224:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c5600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760774.538230:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c39edfe/0x3e099f5ef04aef2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.538241:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c39edfe/0x3e099f5ef04aef2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.538277:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c39edfe/0x3e099f5ef04aef2f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760774.538286:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c39edfe/0x3e099f5ef04aef2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760774.538445:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df14ad64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863175424:12345-192.168.203.12@tcp:4:dd.500 Request processed in 79702us (209444us total) trans 4294967530 rc 0/0 00000100:00100000:1.0:1789760774.538457:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 110 00000100:00100000:1.0:1789760774.538467:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 378571573599 time 378571894400 state 0x2 ref 0 00000100:00100000:3.0:1789760774.545223:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760774.545526:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863175552 00000100:00100000:0.0:1789760774.545539:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863175552 00000100:00100000:0.0:1789760774.545615:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 378571573599 time 378571894400 state 0x0 ref 1 00000100:00100000:0.0:1789760774.545631:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 378771894400 time 378571894400 state 0x1 ref 1 00000100:00100000:2.0:1789760774.658870:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 378771894400 time 378772052100 state 0x0 ref 1 00000100:00100000:2.0:1789760774.658913:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863175552:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760774.658999:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 82837504, mtime: 0x6aad9505, atime: 0x6aad94f6, ctime: 0x6aad9505, blocks: 0x2780d 00010000:00010000:2.0:1789760774.659010:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aef36 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.659041:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=378s v=(0 0) 00010000:00010000:2.0:1789760774.659047:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760774.659055:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aef36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.659072:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aef36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760774.753916:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967531 is committed 00002000:00010000:0.0:1789760774.753988:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 82837504 -> 83886080 00002000:00010000:0.0:1789760774.753994:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 161805 -> 163853 00010000:00010000:0.0:1789760774.754016:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aef36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.754032:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aef36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.754042:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aef36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.754050:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760774.754056:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aef36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.754064:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aef36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.754124:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aef36 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760774.754133:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020a09b91/0x3e099f5ef04aef36 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760774.754346:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863175552:12345-192.168.203.12@tcp:4:dd.500 Request processed in 95449us (209131us total) trans 4294967531 rc 0/0 00000100:00100000:0.0:1789760774.754358:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 111 00000100:00100000:0.0:1789760774.754369:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 378771894400 time 378772052100 state 0x2 ref 0 00000100:00100000:3.0:1789760774.765354:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760774.765524:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863175680 00000100:00100000:1.0:1789760774.765538:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863175680 00000100:00100000:1.0:1789760774.765684:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 378771894400 time 378772052100 state 0x0 ref 1 00000100:00100000:1.0:1789760774.765792:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 378972052100 time 378772052100 state 0x1 ref 1 00000100:00100000:0.0:1789760774.774465:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760774.774503:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760774.774549:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760774.774594:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760774.774639:0:12459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863176064 00000100:00100000:1.0:1789760774.774643:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863175808 00000100:00100000:0.0:1789760774.774652:0:12459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863176064 00000100:00100000:1.0:1789760774.774652:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863175808 00000100:00100000:0.0:1789760774.774713:0:12459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00100000:1.0:1789760774.774713:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 287 00000100:00100000:0.0:1789760774.774724:0:12459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863176064:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1789760774.774724:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2350:x1876699863175808:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1789760774.774839:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2350:x1876699863175808:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 116us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760774.774846:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 287 00000100:00100000:3.0:1789760774.774848:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863175936 00000100:00100000:3.0:1789760774.774852:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863175936 00000100:00100000:3.0:1789760774.774886:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863176192 00000100:00100000:3.0:1789760774.774888:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863176192 00000100:00100000:3.0:1789760774.774908:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 188 00000100:00100000:3.0:1789760774.774915:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+8:2350:x1876699863175936:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1789760774.774991:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 189 00000100:00100000:2.0:1789760774.775002:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2350:x1876699863176192:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1789760774.775071:0:12459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863176064:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 350us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760774.775088:0:12459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00080000:0.0:1789760774.775109:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789760774.775115:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789760774.777995:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+8:2350:x1876699863175936:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 3061us (3536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760774.778013:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 188 00000100:00100000:2.0:1789760774.778182:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2350:x1876699863176192:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 3181us (3675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760774.778191:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 189 00000100:00100000:2.0:1789760774.862303:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 378972052100 time 378975481839 state 0x0 ref 1 00000100:00100000:2.0:1789760774.862351:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863175680:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760774.862441:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 83886080, mtime: 0x6aad9505, atime: 0x6aad94f6, ctime: 0x6aad9505, blocks: 0x2800d 00010000:00010000:2.0:1789760774.862452:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aef3d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.862473:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=378s v=(0 0) 00010000:00010000:2.0:1789760774.862478:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760774.862486:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aef3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.862504:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aef3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760774.933231:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967532 is committed 00002000:00010000:2.0:1789760774.933391:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 83886080 -> 84934656 00002000:00010000:2.0:1789760774.933396:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789760773 -> 1789760774 00002000:00010000:2.0:1789760774.933400:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789760773 -> 1789760774 00002000:00010000:2.0:1789760774.933402:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 163853 -> 165901 00010000:00010000:2.0:1789760774.933426:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aef3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.933441:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aef3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.933452:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aef3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.933459:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760774.933466:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aef3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.933481:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aef3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.933623:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aef3d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760774.933633:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aef3d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760774.933850:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863175680:12345-192.168.203.12@tcp:4:dd.500 Request processed in 71517us (168502us total) trans 4294967532 rc 0/0 00000100:00100000:2.0:1789760774.933862:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 112 00000100:00100000:2.0:1789760774.933872:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 378972052100 time 378975481839 state 0x2 ref 0 00000100:00100000:3.0:1789760774.939894:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760774.940050:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863176320 00000100:00100000:2.0:1789760774.940093:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863176320 00000100:00100000:2.0:1789760774.940170:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 378972052100 time 378975481839 state 0x0 ref 1 00000100:00100000:2.0:1789760774.940187:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 379175481839 time 378975481839 state 0x1 ref 1 00000100:00100000:1.0:1789760775.062912:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 379175481839 time 379176088155 state 0x0 ref 1 00000100:00100000:1.0:1789760775.062966:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863176320:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760775.063056:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 84934656, mtime: 0x6aad9506, atime: 0x6aad94f6, ctime: 0x6aad9506, blocks: 0x2880d 00010000:00010000:1.0:1789760775.063067:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aef44 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.063123:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=379s v=(0 0) 00010000:00010000:1.0:1789760775.063129:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760775.063137:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aef44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760775.063156:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aef44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760775.138835:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967533 is committed 00002000:00010000:3.0:1789760775.138956:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 84934656 -> 85983232 00002000:00010000:3.0:1789760775.138962:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 165901 -> 167949 00010000:00010000:3.0:1789760775.138981:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aef44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.139007:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aef44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.139016:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aef44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.139025:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861ea00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760775.139032:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aef44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.139042:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aef44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.139068:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aef44 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.139086:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046a49a68/0x3e099f5ef04aef44 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760775.139212:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863176320:12345-192.168.203.12@tcp:4:dd.500 Request processed in 76268us (199326us total) trans 4294967533 rc 0/0 00000100:00100000:3.0:1789760775.139247:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 113 00000100:00100000:3.0:1789760775.139258:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 379175481839 time 379176088155 state 0x2 ref 0 00000100:00100000:0.0:1789760775.147565:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760775.147708:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863176448 00000100:00100000:3.0:1789760775.147723:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863176448 00000100:00100000:3.0:1789760775.147845:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 379175481839 time 379176088155 state 0x0 ref 1 00000100:00100000:3.0:1789760775.147862:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 379376088155 time 379176088155 state 0x1 ref 1 00000100:00100000:0.0:1789760775.263066:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 379376088155 time 379376246736 state 0x0 ref 1 00000100:00100000:0.0:1789760775.263128:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863176448:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760775.263210:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 85983232, mtime: 0x6aad9506, atime: 0x6aad94f6, ctime: 0x6aad9506, blocks: 0x2900d 00010000:00010000:0.0:1789760775.263221:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aef4b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.263242:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=379s v=(0 0) 00010000:00010000:0.0:1789760775.263247:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760775.263255:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aef4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.263272:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aef4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760775.324952:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967534 is committed 00002000:00010000:0.0:1789760775.325057:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 85983232 -> 87031808 00002000:00010000:0.0:1789760775.325063:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 167949 -> 169997 00010000:00010000:0.0:1789760775.325094:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aef4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.325109:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aef4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.325120:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aef4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.325153:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627d000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760775.325231:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aef4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.325245:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aef4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.325273:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aef4b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.325283:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc1529d9/0x3e099f5ef04aef4b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760775.325532:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863176448:12345-192.168.203.12@tcp:4:dd.500 Request processed in 62424us (177984us total) trans 4294967534 rc 0/0 00000100:00100000:0.0:1789760775.325546:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:0.0:1789760775.325556:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 379376088155 time 379376246736 state 0x2 ref 0 00000100:00100000:3.0:1789760775.333003:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760775.333286:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863176576 00000100:00100000:2.0:1789760775.333310:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863176576 00000100:00100000:2.0:1789760775.333388:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 379376088155 time 379376246736 state 0x0 ref 1 00000100:00100000:2.0:1789760775.333404:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 379576246736 time 379376246736 state 0x1 ref 1 00010000:00010000:1.0:1789760775.375401:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760775.463219:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 379576246736 time 379576399495 state 0x0 ref 1 00000100:00100000:2.0:1789760775.463270:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863176576:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760775.463362:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 87031808, mtime: 0x6aad9506, atime: 0x6aad94f6, ctime: 0x6aad9506, blocks: 0x2980d 00010000:00010000:2.0:1789760775.463372:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aef52 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.463394:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789760775.463400:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760775.463408:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aef52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.463427:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aef52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760775.531222:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967535 is committed 00002000:00010000:2.0:1789760775.531380:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 87031808 -> 88080384 00002000:00010000:2.0:1789760775.531386:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 169997 -> 172045 00010000:00010000:2.0:1789760775.531406:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aef52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.531440:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aef52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.531451:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aef52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.531459:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760775.531464:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aef52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.531475:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aef52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.531502:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aef52 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760775.531510:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aef52 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760775.531675:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863176576:12345-192.168.203.12@tcp:4:dd.500 Request processed in 68426us (198680us total) trans 4294967535 rc 0/0 00000100:00100000:2.0:1789760775.531687:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:2.0:1789760775.531697:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 379576246736 time 379576399495 state 0x2 ref 0 00000100:00100000:1.0:1789760775.541208:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760775.541406:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863176704 00000100:00100000:2.0:1789760775.541436:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863176704 00000100:00100000:2.0:1789760775.541508:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 379576246736 time 379576399495 state 0x0 ref 1 00000100:00100000:2.0:1789760775.541524:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 379776399495 time 379576399495 state 0x1 ref 1 00000100:00100000:3.0:1789760775.663416:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 379776399495 time 379776596030 state 0x0 ref 1 00000100:00100000:3.0:1789760775.663461:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24626d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863176704:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760775.663563:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 88080384, mtime: 0x6aad9506, atime: 0x6aad94f6, ctime: 0x6aad9506, blocks: 0x2a00d 00010000:00010000:3.0:1789760775.663575:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc0e907e/0x3e099f5ef04aef59 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.663596:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1789760775.663601:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760775.663609:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc0e907e/0x3e099f5ef04aef59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760775.663627:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc0e907e/0x3e099f5ef04aef59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760775.712501:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 88080384 -> 89128960 00002000:00010000:0.0:1789760775.712514:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 172045 -> 174093 00010000:00010000:0.0:1789760775.712535:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc0e907e/0x3e099f5ef04aef59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.712551:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc0e907e/0x3e099f5ef04aef59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.712607:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc0e907e/0x3e099f5ef04aef59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.712615:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c4000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760775.712621:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc0e907e/0x3e099f5ef04aef59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.712631:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc0e907e/0x3e099f5ef04aef59 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.712656:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc0e907e/0x3e099f5ef04aef59 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.712665:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc0e907e/0x3e099f5ef04aef59 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760775.712794:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24626d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+7:2349:x1876699863176704:12345-192.168.203.12@tcp:4:dd.500 Request processed in 49350us (171592us total) trans 4294967536 rc 0/0 00000100:00100000:0.0:1789760775.712848:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 116 00000100:00100000:0.0:1789760775.712859:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 379776399495 time 379776596030 state 0x2 ref 0 00000001:00080000:3.0:1789760775.713003:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967536 is committed 00000100:00100000:1.0:1789760775.722125:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760775.722198:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863176832 00000100:00100000:3.0:1789760775.722212:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863176832 00000100:00100000:3.0:1789760775.722286:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 379776399495 time 379776596030 state 0x0 ref 1 00000100:00100000:3.0:1789760775.722381:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 379976596030 time 379776596030 state 0x1 ref 1 00000100:00100000:2.0:1789760775.759496:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2687dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883061760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760775.759641:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760775.759927:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883061760 00000100:00100000:1.0:1789760775.759938:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883061760 00000100:00100000:1.0:1789760775.760035:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789760775.760048:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25957ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883061760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789760775.760088:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 216334336 pending 0 free 3780116480 avail 3768582144 00000100:00100000:1.0:1789760775.760144:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25957ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883061760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760775.760153:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1789760775.760300:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760775.763580:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2687dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883061760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789760775.867216:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 379976596030 time 379980396658 state 0x0 ref 1 00000100:00100000:0.0:1789760775.867264:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24626ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863176832:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760775.867374:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 89128960, mtime: 0x6aad9506, atime: 0x6aad94f6, ctime: 0x6aad9506, blocks: 0x2a80d 00010000:00010000:0.0:1789760775.867386:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aef60 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.867406:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=379s v=(0 0) 00010000:00010000:0.0:1789760775.867412:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760775.867420:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aef60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.867438:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aef60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760775.930371:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967537 is committed 00002000:00010000:0.0:1789760775.930554:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 89128960 -> 90177536 00002000:00010000:0.0:1789760775.930560:0:11799:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789760774 -> 1789760775 00002000:00010000:0.0:1789760775.930563:0:11799:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789760774 -> 1789760775 00002000:00010000:0.0:1789760775.930566:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 174093 -> 176141 00010000:00010000:0.0:1789760775.930593:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aef60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.930609:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aef60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.930619:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aef60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.930626:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627c400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760775.930650:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aef60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.930659:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aef60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.930686:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aef60 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760775.930694:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aef60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760775.930871:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24626ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863176832:12345-192.168.203.12@tcp:4:dd.500 Request processed in 63625us (208757us total) trans 4294967537 rc 0/0 00000100:00100000:0.0:1789760775.930884:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 117 00000100:00100000:0.0:1789760775.930894:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 379976596030 time 379980396658 state 0x2 ref 0 00000100:00100000:3.0:1789760775.941732:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760775.941862:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863176960 00000100:00100000:2.0:1789760775.941875:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863176960 00000100:00100000:2.0:1789760775.941949:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 379976596030 time 379980396658 state 0x0 ref 1 00000100:00100000:2.0:1789760775.941965:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 380180396658 time 379980396658 state 0x1 ref 1 00000100:00100000:2.0:1789760776.067361:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 380180396658 time 380180541806 state 0x0 ref 1 00000100:00100000:2.0:1789760776.067430:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863176960:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760776.067508:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 90177536, mtime: 0x6aad9507, atime: 0x6aad94f6, ctime: 0x6aad9507, blocks: 0x2b00d 00010000:00010000:2.0:1789760776.067519:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aef67 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.067541:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=380s v=(0 0) 00010000:00010000:2.0:1789760776.067546:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760776.067553:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aef67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760776.067569:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aef67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789760776.067995:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789760776.111355:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967538 is committed 00002000:00010000:0.0:1789760776.111782:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 90177536 -> 91226112 00002000:00010000:0.0:1789760776.111788:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 176141 -> 178189 00010000:00010000:0.0:1789760776.112062:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aef67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.112153:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aef67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.112164:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aef67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.112197:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760776.112203:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aef67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.112214:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aef67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.112252:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aef67 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.112261:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a6ca7e1/0x3e099f5ef04aef67 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760776.112586:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863176960:12345-192.168.203.12@tcp:4:dd.500 Request processed in 45195us (170862us total) trans 4294967538 rc 0/0 00000100:00100000:0.0:1789760776.112599:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:0.0:1789760776.112610:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 380180396658 time 380180541806 state 0x2 ref 0 00000100:00100000:3.0:1789760776.131558:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760776.131730:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863177088 00000100:00100000:2.0:1789760776.131745:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863177088 00000100:00100000:2.0:1789760776.131871:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 380180396658 time 380180541806 state 0x0 ref 1 00000100:00100000:2.0:1789760776.131889:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 380380541806 time 380180541806 state 0x1 ref 1 00000100:00100000:0.0:1789760776.271641:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 380380541806 time 380384716463 state 0x0 ref 1 00000100:00100000:0.0:1789760776.271692:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863177088:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760776.271776:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 91226112, mtime: 0x6aad9507, atime: 0x6aad94f6, ctime: 0x6aad9507, blocks: 0x2b80d 00010000:00010000:0.0:1789760776.271787:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aef6e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.271846:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=380s v=(0 0) 00010000:00010000:0.0:1789760776.271852:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760776.271860:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aef6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.271878:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aef6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760776.355063:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967539 is committed 00002000:00010000:0.0:1789760776.355254:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 91226112 -> 92274688 00002000:00010000:0.0:1789760776.355260:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 178189 -> 180237 00010000:00010000:0.0:1789760776.355278:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aef6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.355302:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aef6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.355312:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aef6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.355320:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627c400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760776.355326:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aef6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.355335:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aef6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.355379:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aef6e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.355387:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aef6e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760776.355504:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863177088:12345-192.168.203.12@tcp:4:dd.500 Request processed in 83833us (223957us total) trans 4294967539 rc 0/0 00000100:00100000:0.0:1789760776.355515:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:0.0:1789760776.355525:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 380380541806 time 380384716463 state 0x2 ref 0 00000100:00100000:1.0:1789760776.361933:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760776.362164:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863177216 00000100:00100000:3.0:1789760776.362177:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863177216 00000100:00100000:3.0:1789760776.362252:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 380380541806 time 380384716463 state 0x0 ref 1 00000100:00100000:3.0:1789760776.362270:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 380584716463 time 380384716463 state 0x1 ref 1 00010000:00010000:0.0:1789760776.399374:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760776.472747:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 380584716463 time 380585927422 state 0x0 ref 1 00000100:00100000:0.0:1789760776.472797:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24626f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863177216:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760776.472929:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 92274688, mtime: 0x6aad9507, atime: 0x6aad94f6, ctime: 0x6aad9507, blocks: 0x2c00d 00010000:00010000:0.0:1789760776.472939:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aef75 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.472959:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=380s v=(0 0) 00010000:00010000:0.0:1789760776.472964:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760776.472971:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aef75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.472988:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aef75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789760776.525143:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967540 is committed 00002000:00010000:3.0:1789760776.525360:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 92274688 -> 93323264 00002000:00010000:3.0:1789760776.525367:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 180237 -> 182285 00010000:00010000:3.0:1789760776.525385:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aef75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.525400:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aef75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.525409:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aef75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.525418:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627c400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760776.525442:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aef75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.525454:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aef75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.525480:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aef75 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760776.525488:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000267cb156/0x3e099f5ef04aef75 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760776.525755:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24626f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863177216:12345-192.168.203.12@tcp:4:dd.500 Request processed in 52977us (163831us total) trans 4294967540 rc 0/0 00000100:00100000:3.0:1789760776.525767:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:3.0:1789760776.525777:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 380584716463 time 380585927422 state 0x2 ref 0 00000100:00100000:2.0:1789760776.532219:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760776.532588:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863177344 00000100:00100000:0.0:1789760776.532602:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863177344 00000100:00100000:0.0:1789760776.532677:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 380584716463 time 380585927422 state 0x0 ref 1 00000100:00100000:0.0:1789760776.532693:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 380785927422 time 380585927422 state 0x1 ref 1 00000100:00100000:0.0:1789760776.673485:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 380785927422 time 380786666161 state 0x0 ref 1 00000100:00100000:0.0:1789760776.673543:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25957c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863177344:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760776.673629:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 93323264, mtime: 0x6aad9507, atime: 0x6aad94f6, ctime: 0x6aad9507, blocks: 0x2c80d 00010000:00010000:0.0:1789760776.673641:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ce144da/0x3e099f5ef04aef7c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.673663:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=380s v=(0 0) 00010000:00010000:0.0:1789760776.673669:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760776.673678:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ce144da/0x3e099f5ef04aef7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.673696:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ce144da/0x3e099f5ef04aef7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760776.730639:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 93323264 -> 94371840 00002000:00010000:1.0:1789760776.730651:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 182285 -> 184333 00010000:00010000:1.0:1789760776.730670:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ce144da/0x3e099f5ef04aef7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.730685:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ce144da/0x3e099f5ef04aef7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.730713:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ce144da/0x3e099f5ef04aef7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.730722:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627ce00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760776.730727:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ce144da/0x3e099f5ef04aef7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.730737:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ce144da/0x3e099f5ef04aef7c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.730763:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ce144da/0x3e099f5ef04aef7c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.730772:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ce144da/0x3e099f5ef04aef7c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760776.730914:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967541 is committed 00000100:00100000:1.0:1789760776.731072:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25957c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863177344:12345-192.168.203.12@tcp:4:dd.500 Request processed in 57551us (198854us total) trans 4294967541 rc 0/0 00000100:00100000:1.0:1789760776.731085:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:1.0:1789760776.731095:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 380785927422 time 380786666161 state 0x2 ref 0 00000100:00100000:3.0:1789760776.738178:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760776.739269:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863177472 00000100:00100000:2.0:1789760776.739285:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863177472 00000100:00100000:2.0:1789760776.739719:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 380785927422 time 380786666161 state 0x0 ref 1 00000100:00100000:2.0:1789760776.739964:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 380986666161 time 380786666161 state 0x1 ref 1 00000100:00100000:0.0:1789760776.874123:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 380986666161 time 380987300814 state 0x0 ref 1 00000100:00100000:0.0:1789760776.874172:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863177472:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760776.874270:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 94371840, mtime: 0x6aad9507, atime: 0x6aad94f6, ctime: 0x6aad9507, blocks: 0x2d00d 00010000:00010000:0.0:1789760776.874301:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aef83 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.874323:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=380s v=(0 0) 00010000:00010000:0.0:1789760776.874329:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760776.874337:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aef83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760776.874355:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aef83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789760776.981353:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 94371840 -> 95420416 00002000:00010000:1.0:1789760776.981365:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789760775 -> 1789760776 00002000:00010000:1.0:1789760776.981368:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789760775 -> 1789760776 00002000:00010000:1.0:1789760776.981371:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 184333 -> 186381 00010000:00010000:1.0:1789760776.981410:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aef83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.981425:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aef83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.981435:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aef83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.981444:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627d400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760776.981451:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aef83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.981461:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aef83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.981491:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aef83 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760776.981501:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000664bccca/0x3e099f5ef04aef83 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760776.981635:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+7:2349:x1876699863177472:12345-192.168.203.12@tcp:4:dd.500 Request processed in 107481us (243462us total) trans 4294967542 rc 0/0 00000100:00100000:1.0:1789760776.981650:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:1.0:1789760776.981661:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 380986666161 time 380987300814 state 0x2 ref 0 00000001:00080000:2.0:1789760776.981847:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967542 is committed 00000100:00100000:1.0:1789760776.987785:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760776.987939:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863177600 00000100:00100000:2.0:1789760776.987955:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863177600 00000100:00100000:2.0:1789760776.988035:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 380986666161 time 380987300814 state 0x0 ref 1 00000100:00100000:2.0:1789760776.988052:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 381187300814 time 380987300814 state 0x1 ref 1 00000100:00100000:3.0:1789760777.074326:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 381187300814 time 381187503045 state 0x0 ref 1 00000100:00100000:3.0:1789760777.074390:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24626c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863177600:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760777.074473:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 95420416, mtime: 0x6aad9508, atime: 0x6aad94f6, ctime: 0x6aad9508, blocks: 0x2d80d 00010000:00010000:3.0:1789760777.074484:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c39edfe/0x3e099f5ef04aef8a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.074503:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=381s v=(0 0) 00010000:00010000:3.0:1789760777.074527:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760777.074536:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c39edfe/0x3e099f5ef04aef8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.074553:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c39edfe/0x3e099f5ef04aef8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760777.163929:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967543 is committed 00002000:00010000:0.0:1789760777.164055:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 95420416 -> 96468992 00002000:00010000:0.0:1789760777.164071:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 186381 -> 188429 00010000:00010000:0.0:1789760777.164090:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c39edfe/0x3e099f5ef04aef8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.164230:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c39edfe/0x3e099f5ef04aef8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.164241:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c39edfe/0x3e099f5ef04aef8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.164250:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c5600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760777.164256:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c39edfe/0x3e099f5ef04aef8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.164267:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c39edfe/0x3e099f5ef04aef8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.164311:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c39edfe/0x3e099f5ef04aef8a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.164319:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c39edfe/0x3e099f5ef04aef8a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760777.164490:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24626c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863177600:12345-192.168.203.12@tcp:4:dd.500 Request processed in 90133us (176711us total) trans 4294967543 rc 0/0 00000100:00100000:0.0:1789760777.164503:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:0.0:1789760777.164513:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 381187300814 time 381187503045 state 0x2 ref 0 00000100:00100000:1.0:1789760777.173233:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760777.173338:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863177728 00000100:00100000:3.0:1789760777.173353:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863177728 00000100:00100000:3.0:1789760777.173424:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 381187300814 time 381187503045 state 0x0 ref 1 00000100:00100000:3.0:1789760777.173441:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 381387503045 time 381187503045 state 0x1 ref 1 00000100:00100000:1.0:1789760777.275212:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 381387503045 time 381388295393 state 0x0 ref 1 00000100:00100000:1.0:1789760777.275258:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24626ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863177728:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760777.275334:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 96468992, mtime: 0x6aad9508, atime: 0x6aad94f6, ctime: 0x6aad9508, blocks: 0x2e00d 00010000:00010000:1.0:1789760777.275345:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aef91 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.275374:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=381s v=(0 0) 00010000:00010000:1.0:1789760777.275379:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760777.275386:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aef91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.275403:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aef91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760777.296244:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df259bdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883061888:0@lo:400:kworker.0 00000100:00100000:0.0:1789760777.296348:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760777.296419:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df259bded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1876699883062400:0@lo:400:kworker.0 00000100:00100000:0.0:1789760777.296451:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760777.296483:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789760777.296489:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df259bddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876699883062016:0@lo:400:kworker.0 00000100:00100000:0.0:1789760777.296513:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760777.296546:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df259bdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883062528:0@lo:400:kworker.0 00000100:00100000:0.0:1789760777.296585:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760777.296623:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df259bde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883062144:0@lo:400:kworker.0 00000100:00100000:0.0:1789760777.296649:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760777.296669:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789760777.296675:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df259bdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883062272:0@lo:400:kworker.0 00000100:00100000:0.0:1789760777.296726:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760777.296764:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883061888 00000100:00100000:0.0:1789760777.296774:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883061888 00000100:00100000:0.0:1789760777.296890:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1789760777.296902:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883061888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760777.296975:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883061888:12345-0@lo:400:kworker.0 Request processed in 75us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760777.296983:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1789760777.297024:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883062400 00000100:00100000:0.0:1789760777.297028:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883062400 00000100:00100000:0.0:1789760777.297083:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883062016 00000100:00100000:0.0:1789760777.297088:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883062016 00000100:00100000:0.0:1789760777.297103:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883062144 00000100:00100000:0.0:1789760777.297105:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883062144 00000100:00100000:3.0:1789760777.297117:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df259bdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883061888:0@lo:400:kworker.0 00000100:00100000:0.0:1789760777.297118:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789760777.297123:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876699883062400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760777.297622:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789760777.298903:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876699883062016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760777.299235:0:5844:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789760777.299247:0:5844:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:2.0:1789760777.299267:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760777.299287:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883062528 00000100:00100000:2.0:1789760777.299295:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883062528 00000100:00100000:2.0:1789760777.299362:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883062272 00000100:00100000:2.0:1789760777.299366:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883062272 00000100:00100000:2.0:1789760777.299407:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789760777.299415:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883062528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760777.300097:0:12460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789760777.300109:0:12460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883062272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760777.300178:0:12460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883062272:12345-0@lo:400:kworker.0 Request processed in 71us (3450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760777.300186:0:12460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789760777.300316:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876699883062400:12345-0@lo:400:kworker.0 Request processed in 3190us (3862us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760777.300328:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789760777.300350:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789760777.300358:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883062144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760777.300395:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883062144:12345-0@lo:400:kworker.0 Request processed in 39us (3745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760777.300400:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789760777.300448:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df259bdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883062272:0@lo:400:kworker.0 00000100:00100000:0.0:1789760777.300466:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df259bde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883062144:0@lo:400:kworker.0 00000100:00100000:1.0:1789760777.300495:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876699883062016:12345-0@lo:400:kworker.0 Request processed in 2861us (3978us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760777.300505:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789760777.300508:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df259bddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876699883062016:0@lo:400:kworker.0 00000100:00100000:3.0:1789760777.301111:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df259bdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1876699883062528:0@lo:400:kworker.0 00000100:00100000:2.0:1789760777.301112:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876699883062528:12345-0@lo:400:kworker.0 Request processed in 1693us (4533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760777.301127:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df259bded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1876699883062400:0@lo:400:kworker.0 00000100:00100000:2.0:1789760777.301131:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:1.0:1789760777.301316:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789760777.301323:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1789760777.328503:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 96468992 -> 97517568 00002000:00010000:1.0:1789760777.328518:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 188429 -> 190477 00010000:00010000:1.0:1789760777.328538:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aef91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.328573:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aef91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.328585:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aef91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.328593:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861f600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760777.328599:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aef91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.328610:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aef91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.328638:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aef91 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.328647:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aef91 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.328992:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24626ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+7:2351:x1876699863177728:12345-192.168.203.12@tcp:4:dd.500 Request processed in 53745us (155763us total) trans 4294967544 rc 0/0 00000100:00100000:1.0:1789760777.329006:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:1.0:1789760777.329017:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 381387503045 time 381388295393 state 0x2 ref 0 00000001:00080000:2.0:1789760777.329068:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967544 is committed 00000100:00100000:3.0:1789760777.339993:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760777.340148:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863177856 00000100:00100000:1.0:1789760777.340185:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863177856 00000100:00100000:1.0:1789760777.340259:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 381387503045 time 381388295393 state 0x0 ref 1 00000100:00100000:1.0:1789760777.340274:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 381588295393 time 381388295393 state 0x1 ref 1 00010000:00010000:2.0:1789760777.423226:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760777.475253:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 381588295393 time 381588434784 state 0x0 ref 1 00000100:00100000:1.0:1789760777.475301:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863177856:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760777.475393:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 97517568, mtime: 0x6aad9508, atime: 0x6aad94f6, ctime: 0x6aad9508, blocks: 0x2e80d 00010000:00010000:1.0:1789760777.475404:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aef98 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.475427:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=381s v=(0 0) 00010000:00010000:1.0:1789760777.475432:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760777.475438:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aef98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.475454:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aef98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760777.540090:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967545 is committed 00002000:00010000:1.0:1789760777.540242:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 97517568 -> 98566144 00002000:00010000:1.0:1789760777.540248:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 190477 -> 192525 00010000:00010000:1.0:1789760777.540266:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aef98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.540288:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aef98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.540320:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aef98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.540328:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861f600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760777.540334:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aef98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.540344:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aef98 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.540368:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aef98 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.540377:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aef98 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760777.540506:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863177856:12345-192.168.203.12@tcp:4:dd.500 Request processed in 65225us (200521us total) trans 4294967545 rc 0/0 00000100:00100000:1.0:1789760777.540518:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:1.0:1789760777.540529:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 381588295393 time 381588434784 state 0x2 ref 0 00000100:00100000:2.0:1789760777.551141:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760777.551558:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863177984 00000100:00100000:0.0:1789760777.551574:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863177984 00000100:00100000:0.0:1789760777.551651:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 381588295393 time 381588434784 state 0x0 ref 1 00000100:00100000:0.0:1789760777.551668:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 381788434784 time 381588434784 state 0x1 ref 1 00000100:00100000:0.0:1789760777.675392:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 381788434784 time 381788571201 state 0x0 ref 1 00000100:00100000:0.0:1789760777.675438:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25957f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863177984:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760777.675515:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 98566144, mtime: 0x6aad9508, atime: 0x6aad94f6, ctime: 0x6aad9508, blocks: 0x2f00d 00010000:00010000:0.0:1789760777.675527:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e85c43d2/0x3e099f5ef04aef9f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.675546:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=381s v=(0 0) 00010000:00010000:0.0:1789760777.675552:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760777.675560:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e85c43d2/0x3e099f5ef04aef9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.675577:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e85c43d2/0x3e099f5ef04aef9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789760777.781399:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967546 is committed 00002000:00010000:0.0:1789760777.781558:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 98566144 -> 99614720 00002000:00010000:0.0:1789760777.781574:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 192525 -> 194575 00010000:00010000:0.0:1789760777.781594:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e85c43d2/0x3e099f5ef04aef9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.781609:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e85c43d2/0x3e099f5ef04aef9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.781640:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e85c43d2/0x3e099f5ef04aef9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.781648:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627de00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760777.781655:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e85c43d2/0x3e099f5ef04aef9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.781666:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e85c43d2/0x3e099f5ef04aef9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.781692:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e85c43d2/0x3e099f5ef04aef9f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760777.781699:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e85c43d2/0x3e099f5ef04aef9f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760777.781878:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25957f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863177984:12345-192.168.203.12@tcp:4:dd.500 Request processed in 106458us (230745us total) trans 4294967546 rc 0/0 00000100:00100000:0.0:1789760777.781891:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:0.0:1789760777.781902:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 381788434784 time 381788571201 state 0x2 ref 0 00000100:00100000:2.0:1789760777.792552:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760777.792780:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863178112 00000100:00100000:3.0:1789760777.792855:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863178112 00000100:00100000:3.0:1789760777.792929:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 381788434784 time 381788571201 state 0x0 ref 1 00000100:00100000:3.0:1789760777.792944:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 381988571201 time 381788571201 state 0x1 ref 1 00000100:00100000:1.0:1789760777.807169:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789760777.807199:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df259bde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883062656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760777.807287:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760777.807401:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883062656 00000100:00100000:0.0:1789760777.807413:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883062656 00000100:00100000:0.0:1789760777.807476:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789760777.807498:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24626ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883062656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789760777.807565:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 71499776 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760777.807629:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24626ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883062656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760777.807638:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789760777.807685:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df259bde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883062656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760777.875763:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 381988571201 time 381988945032 state 0x0 ref 1 00000100:00100000:1.0:1789760777.875850:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25957df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863178112:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760777.875923:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 99614720, mtime: 0x6aad9508, atime: 0x6aad94f6, ctime: 0x6aad9508, blocks: 0x2f80f 00010000:00010000:1.0:1789760777.875932:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aefa6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.875949:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=381s v=(0 0) 00010000:00010000:1.0:1789760777.875953:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760777.875958:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aefa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760777.875972:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aefa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789760777.923870:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967547 is committed 00002000:00010000:3.0:1789760777.924519:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 99614720 -> 100663296 00002000:00010000:3.0:1789760777.924527:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 1789760776 -> 1789760777 00002000:00010000:3.0:1789760777.924530:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 1789760776 -> 1789760777 00002000:00010000:3.0:1789760777.924532:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 194575 -> 196623 00010000:00010000:3.0:1789760777.924551:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aefa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.924567:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aefa6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.924589:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aefa6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.924598:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861f600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760777.924604:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aefa6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.924615:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aefa6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.924643:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aefa6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760777.924678:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008467abb9/0x3e099f5ef04aefa6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760777.925127:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25957df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863178112:12345-192.168.203.12@tcp:4:dd.500 Request processed in 49335us (132582us total) trans 4294967547 rc 0/0 00000100:00100000:3.0:1789760777.925145:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 127 00000100:00100000:3.0:1789760777.925155:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 381988571201 time 381988945032 state 0x2 ref 0 00000100:00100000:0.0:1789760777.948368:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760777.949755:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863178240 00000100:00100000:1.0:1789760777.949773:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863178240 00000100:00100000:2.0:1789760777.950080:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 381988571201 time 381988945032 state 0x0 ref 1 00000100:00100000:2.0:1789760777.950098:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 382188945032 time 381988945032 state 0x1 ref 1 00000100:00100000:1.0:1789760778.076318:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 382188945032 time 382189496840 state 0x0 ref 1 00000100:00100000:1.0:1789760778.076504:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863178240:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:1.0:1789760778.076599:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 100663296, mtime: 0x6aad9509, atime: 0x6aad94f6, ctime: 0x6aad9509, blocks: 0x3000f 00010000:00010000:1.0:1789760778.076611:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000486a4f5f/0x3e099f5ef04aefad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.076632:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=382s v=(0 0) 00010000:00010000:1.0:1789760778.076637:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760778.076665:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000486a4f5f/0x3e099f5ef04aefad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760778.076682:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000486a4f5f/0x3e099f5ef04aefad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789760778.077269:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789760778.140932:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967548 is committed 00002000:00010000:2.0:1789760778.141073:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 100663296 -> 101711872 00002000:00010000:2.0:1789760778.141079:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 196623 -> 198671 00010000:00010000:2.0:1789760778.141098:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000486a4f5f/0x3e099f5ef04aefad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.141114:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000486a4f5f/0x3e099f5ef04aefad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.141124:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000486a4f5f/0x3e099f5ef04aefad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.141131:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25861f400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760778.141137:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000486a4f5f/0x3e099f5ef04aefad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.141169:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000486a4f5f/0x3e099f5ef04aefad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.141263:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000486a4f5f/0x3e099f5ef04aefad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.141286:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000486a4f5f/0x3e099f5ef04aefad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.141485:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2348:x1876699863178240:12345-192.168.203.12@tcp:4:dd.500 Request processed in 65137us (193125us total) trans 4294967548 rc 0/0 00000100:00100000:2.0:1789760778.141497:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 128 00000100:00100000:2.0:1789760778.141507:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 382188945032 time 382189496840 state 0x2 ref 0 00000100:00100000:3.0:1789760778.150506:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760778.150884:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863178368 00000100:00100000:0.0:1789760778.150899:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863178368 00000100:00100000:0.0:1789760778.150975:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 382188945032 time 382189496840 state 0x0 ref 1 00000100:00100000:0.0:1789760778.150990:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 382389496840 time 382189496840 state 0x1 ref 1 00000100:00100000:0.0:1789760778.277107:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 382389496840 time 382390285443 state 0x0 ref 1 00000100:00100000:0.0:1789760778.277155:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+5:2350:x1876699863178368:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:0.0:1789760778.277241:0:11799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 101711872, mtime: 0x6aad9509, atime: 0x6aad94f6, ctime: 0x6aad9509, blocks: 0x3080f 00010000:00010000:0.0:1789760778.277253:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b80f35c/0x3e099f5ef04aefb4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.277274:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=382s v=(0 0) 00010000:00010000:0.0:1789760778.277281:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760778.277288:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b80f35c/0x3e099f5ef04aefb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.277304:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b80f35c/0x3e099f5ef04aefb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760778.350495:0:11799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 101711872 -> 102760448 00002000:00010000:0.0:1789760778.350504:0:11799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 198671 -> 200719 00010000:00010000:0.0:1789760778.350518:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b80f35c/0x3e099f5ef04aefb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.350530:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b80f35c/0x3e099f5ef04aefb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.350538:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b80f35c/0x3e099f5ef04aefb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.350546:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627ca00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760778.350551:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b80f35c/0x3e099f5ef04aefb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.350560:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b80f35c/0x3e099f5ef04aefb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.350580:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b80f35c/0x3e099f5ef04aefb4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.350589:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b80f35c/0x3e099f5ef04aefb4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760778.350691:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+7:2350:x1876699863178368:12345-192.168.203.12@tcp:4:dd.500 Request processed in 73556us (200193us total) trans 4294967549 rc 0/0 00000100:00100000:0.0:1789760778.350714:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 129 00000100:00100000:0.0:1789760778.350722:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 382389496840 time 382390285443 state 0x2 ref 0 00000001:00080000:0.0:1789760778.350761:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967549 is committed 00000100:00100000:2.0:1789760778.356074:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760778.356566:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863178496 00000100:00100000:3.0:1789760778.356577:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863178496 00000100:00100000:3.0:1789760778.356630:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 382389496840 time 382390285443 state 0x0 ref 1 00000100:00100000:3.0:1789760778.356642:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 382590285443 time 382390285443 state 0x1 ref 1 00010000:00010000:1.0:1789760778.449852:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760778.477208:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 382590285443 time 382590394857 state 0x0 ref 1 00000100:00100000:3.0:1789760778.477241:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25957e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863178496:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:3.0:1789760778.477300:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 102760448, mtime: 0x6aad9509, atime: 0x6aad94f6, ctime: 0x6aad9509, blocks: 0x3100f 00010000:00010000:3.0:1789760778.477309:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009683602f/0x3e099f5ef04aefbb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.477323:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=382s v=(0 0) 00010000:00010000:3.0:1789760778.477327:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760778.477333:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009683602f/0x3e099f5ef04aefbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760778.477368:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009683602f/0x3e099f5ef04aefbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789760778.528170:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967550 is committed 00002000:00010000:0.0:1789760778.528243:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 102760448 -> 103809024 00002000:00010000:0.0:1789760778.528247:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 200719 -> 202767 00010000:00010000:0.0:1789760778.528259:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009683602f/0x3e099f5ef04aefbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.528267:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009683602f/0x3e099f5ef04aefbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.528275:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009683602f/0x3e099f5ef04aefbb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.528283:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c5c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760778.528287:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009683602f/0x3e099f5ef04aefbb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.528296:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009683602f/0x3e099f5ef04aefbb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.528316:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009683602f/0x3e099f5ef04aefbb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.528324:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009683602f/0x3e099f5ef04aefbb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760778.528786:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25957e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+5:2349:x1876699863178496:12345-192.168.203.12@tcp:4:dd.500 Request processed in 51556us (172727us total) trans 4294967550 rc 0/0 00000100:00100000:0.0:1789760778.528796:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 130 00000100:00100000:0.0:1789760778.528852:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 382590285443 time 382590394857 state 0x2 ref 0 00000100:00100000:0.0:1789760778.535177:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760778.535340:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863178624 00000100:00100000:3.0:1789760778.535351:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863178624 00000100:00100000:3.0:1789760778.535418:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 382590285443 time 382590394857 state 0x0 ref 1 00000100:00100000:3.0:1789760778.535430:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 382790394857 time 382590394857 state 0x1 ref 1 00000100:00100000:2.0:1789760778.677383:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 382790394857 time 382790567613 state 0x0 ref 1 00000100:00100000:2.0:1789760778.677419:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863178624:12345-192.168.203.12@tcp:4:dd.500 00002000:00010000:2.0:1789760778.677485:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 103809024, mtime: 0x6aad9509, atime: 0x6aad94f6, ctime: 0x6aad9509, blocks: 0x3180f 00010000:00010000:2.0:1789760778.677496:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f46fd71/0x3e099f5ef04aefc2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.677514:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=382s v=(0 0) 00010000:00010000:2.0:1789760778.677519:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760778.677525:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f46fd71/0x3e099f5ef04aefc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.677559:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f46fd71/0x3e099f5ef04aefc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789760778.723295:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 103809024 -> 104857600 00002000:00010000:2.0:1789760778.723305:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 202767 -> 204815 00010000:00010000:2.0:1789760778.723318:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f46fd71/0x3e099f5ef04aefc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.723330:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f46fd71/0x3e099f5ef04aefc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.723338:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f46fd71/0x3e099f5ef04aefc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.723345:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760778.723349:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f46fd71/0x3e099f5ef04aefc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.723357:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f46fd71/0x3e099f5ef04aefc2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.723376:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f46fd71/0x3e099f5ef04aefc2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760778.723383:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f46fd71/0x3e099f5ef04aefc2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760778.723489:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+7:2351:x1876699863178624:12345-192.168.203.12@tcp:4:dd.500 Request processed in 46084us (188316us total) trans 4294967551 rc 0/0 00000100:00100000:2.0:1789760778.723499:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 131 00000100:00100000:2.0:1789760778.723507:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 382790394857 time 382790567613 state 0x2 ref 0 00000001:00080000:0.0:1789760778.723835:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967551 is committed 00000100:00100000:0.0:1789760778.728351:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760778.728454:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863178880 00000100:00100000:3.0:1789760778.728465:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863178880 00000100:00080000:2.0:1789760778.728588:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760778.728631:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:3.0:1789760778.728642:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+8:11132:x1876699863178880:12345-192.168.203.12@tcp:35:dd.500 00000001:00080000:3.0:1789760778.729086:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00000100:00100000:3.0:1789760778.729208:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+10:11132:x1876699863178880:12345-192.168.203.12@tcp:35:dd.500 Request processed in 567us (864us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1789760778.729217:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000020:00080000:3.0:1789760778.729221:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789760778.844005:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760778.844118:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863179136 00000100:00100000:0.0:1789760778.844138:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863179136 00000100:00100000:0.0:1789760778.844206:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 144 00000100:00100000:0.0:1789760778.844217:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25957d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+10:11150:x1876699863179136:12345-192.168.203.12@tcp:101:dd.500 00010000:00010000:0.0:1789760778.844241:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760778.844264:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c600/0x3e099f5ef04aefc9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d378 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.844352:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ca00/0x3e099f5ef04aefd0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.844367:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ca00/0x3e099f5ef04aefd0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.844380:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ca00/0x3e099f5ef04aefd0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.844394:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c200/0x3e099f5ef04aefd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.844422:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c200/0x3e099f5ef04aefd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.844430:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c200/0x3e099f5ef04aefd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.844960:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d800/0x3e099f5ef04aefde lrc: 3/1,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.844972:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d800/0x3e099f5ef04aefde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.844980:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d800/0x3e099f5ef04aefde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760778.844993:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x15:0x0]: returning size 104857600 00010000:00010000:0.0:1789760778.845102:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ca00/0x3e099f5ef04aefd0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.845110:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ca00/0x3e099f5ef04aefd0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.845117:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ca00/0x3e099f5ef04aefd0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.845124:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627ca00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760778.845128:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ca00/0x3e099f5ef04aefd0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.845135:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ca00/0x3e099f5ef04aefd0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.845159:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff8df250325b00) 00010000:00010000:0.0:1789760778.845162:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760778.845167:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ca00/0x3e099f5ef04aefd0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.845173:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627ca00/0x3e099f5ef04aefd0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.845187:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c200/0x3e099f5ef04aefd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.845193:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c200/0x3e099f5ef04aefd7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.845198:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c200/0x3e099f5ef04aefd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.845203:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627c200 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760778.845205:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c200/0x3e099f5ef04aefd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.845211:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c200/0x3e099f5ef04aefd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.845218:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x4009f790 (ffff8df2502f3500) 00010000:00010000:0.0:1789760778.845220:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760778.845223:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c200/0x3e099f5ef04aefd7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.845229:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c200/0x3e099f5ef04aefd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.845281:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627c600/0x3e099f5ef04aefc9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d378 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.845295:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d800/0x3e099f5ef04aefde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d378 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.845303:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff8df2502f3700) 00010000:00010000:0.0:1789760778.845305:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789760778.845308:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df24627d800, rc 0) 00000100:00100000:0.0:1789760778.845384:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25957d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+12:11150:x1876699863179136:12345-192.168.203.12@tcp:101:dd.500 Request processed in 1169us (1389us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1789760778.845393:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 144 00000100:00100000:2.0:1789760778.856153:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760778.856763:0:12459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863179264 00000100:00100000:0.0:1789760778.856774:0:12459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863179264 00000100:00100000:0.0:1789760778.856957:0:12459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 103 00000100:00100000:0.0:1789760778.856979:0:12459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25957ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1da0113a-370d-4d79-883c-54efc174697f+5:2351:x1876699863179264:12345-192.168.203.12@tcp:101:dd.500 00010000:00010000:0.0:1789760778.856997:0:12459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760778.857018:0:12459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033a92095/0x3e099f5ef04aefec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d37f expref: -99 pid: 12459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789760778.857045:0:12459:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 104857600, mtime: 0x6aad9509, atime: 0x6aad94f6, ctime: 0x6aad9509, blocks: 0x3200f 00010000:00010000:0.0:1789760778.857076:0:12459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=382s v=(0 0) 00010000:00010000:0.0:1789760778.857080:0:12459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760778.857089:0:12459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033a92095/0x3e099f5ef04aefec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d37f expref: 6 pid: 12459 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.857131:0:12459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000033a92095/0x3e099f5ef04aefec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d37f expref: 6 pid: 12459 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.857145:0:12459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df24627c600, rc 0) 00000100:00100000:0.0:1789760778.857212:0:12459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25957ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863179264:12345-192.168.203.12@tcp:101:dd.500 Request processed in 246us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760778.857219:0:12459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 103 00000100:00100000:2.0:1789760778.864216:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760778.864378:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863179392 00000100:00100000:0.0:1789760778.864393:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863179392 00000100:00100000:0.0:1789760778.864450:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 382790394857 time 382790567613 state 0x0 ref 1 00000100:00100000:0.0:1789760778.864463:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 382990567613 time 382790567613 state 0x1 ref 1 00000100:00100000:0.0:1789760778.877527:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 382990567613 time 382990713589 state 0x0 ref 1 00000100:00100000:0.0:1789760778.877560:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25957c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863179392:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760778.877601:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d571eff3/0x3e099f5ef04aeff3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.877617:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760778.877621:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760778.877627:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d571eff3/0x3e099f5ef04aeff3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.877640:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d571eff3/0x3e099f5ef04aeff3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.894024:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d571eff3/0x3e099f5ef04aeff3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.894043:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d571eff3/0x3e099f5ef04aeff3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.894062:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d571eff3/0x3e099f5ef04aeff3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.894070:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627c200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760778.894074:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d571eff3/0x3e099f5ef04aeff3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.894084:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d571eff3/0x3e099f5ef04aeff3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.894104:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d571eff3/0x3e099f5ef04aeff3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760778.894112:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d571eff3/0x3e099f5ef04aeff3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760778.894239:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25957c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863179392:12345-192.168.203.12@tcp:3:dd.500 Request processed in 16689us (30029us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760778.894249:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 132 00000100:00100000:0.0:1789760778.894257:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 382990567613 time 382990713589 state 0x2 ref 0 00000100:00100000:1.0:1789760778.910061:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760778.910169:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863179520 00000100:00100000:0.0:1789760778.910178:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863179520 00000100:00100000:0.0:1789760778.910231:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 382990567613 time 382990713589 state 0x0 ref 1 00000100:00100000:0.0:1789760778.910244:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 383190713589 time 382990713589 state 0x1 ref 1 00000100:00100000:0.0:1789760779.079378:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 383190713589 time 383192560023 state 0x0 ref 1 00000100:00100000:0.0:1789760779.079417:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24626c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863179520:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760779.079877:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d571eff3/0x3e099f5ef04aeffa lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.079897:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789760779.079902:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760779.079908:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d571eff3/0x3e099f5ef04aeffa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.079922:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d571eff3/0x3e099f5ef04aeffa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.098530:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d571eff3/0x3e099f5ef04aeffa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.098551:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d571eff3/0x3e099f5ef04aeffa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.098561:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d571eff3/0x3e099f5ef04aeffa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.098586:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df24627c200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760779.098591:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d571eff3/0x3e099f5ef04aeffa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.098601:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d571eff3/0x3e099f5ef04aeffa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.098621:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d571eff3/0x3e099f5ef04aeffa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.098630:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d571eff3/0x3e099f5ef04aeffa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760779.098717:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24626c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863179520:12345-192.168.203.12@tcp:3:dd.500 Request processed in 19316us (188682us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760779.098728:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 133 00000100:00100000:0.0:1789760779.098735:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 383190713589 time 383192560023 state 0x2 ref 0 00000100:00100000:1.0:1789760779.105711:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760779.106072:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863179648 00000100:00100000:2.0:1789760779.106083:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863179648 00000100:00100000:2.0:1789760779.106207:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 383190713589 time 383192560023 state 0x0 ref 1 00000100:00100000:2.0:1789760779.106220:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 383392560023 time 383192560023 state 0x1 ref 1 00000100:00100000:2.0:1789760779.280406:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 383392560023 time 383393590779 state 0x0 ref 1 00000100:00100000:2.0:1789760779.280439:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24626f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863179648:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760779.280491:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a76b506f/0x3e099f5ef04af001 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.280510:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760779.280514:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760779.281358:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a76b506f/0x3e099f5ef04af001 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.281375:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a76b506f/0x3e099f5ef04af001 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.309042:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a76b506f/0x3e099f5ef04af001 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.309074:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a76b506f/0x3e099f5ef04af001 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.309084:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a76b506f/0x3e099f5ef04af001 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.309091:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243ea0400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760779.309096:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a76b506f/0x3e099f5ef04af001 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.309115:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a76b506f/0x3e099f5ef04af001 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.309136:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a76b506f/0x3e099f5ef04af001 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.309143:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a76b506f/0x3e099f5ef04af001 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760779.310081:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24626f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863179648:12345-192.168.203.12@tcp:3:dd.500 Request processed in 29651us (204371us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760779.310094:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 134 00000100:00100000:2.0:1789760779.310125:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 383392560023 time 383393590779 state 0x2 ref 0 00000100:00100000:0.0:1789760779.322193:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760779.323168:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863179776 00000100:00100000:1.0:1789760779.323179:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863179776 00000100:00100000:1.0:1789760779.323237:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 383392560023 time 383393590779 state 0x0 ref 1 00000100:00100000:1.0:1789760779.323249:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 383593590779 time 383393590779 state 0x1 ref 1 00010000:00010000:0.0:1789760779.470988:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760779.480995:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 383593590779 time 383594178382 state 0x0 ref 1 00000100:00100000:0.0:1789760779.481033:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863179776:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760779.481087:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008c973ad8/0x3e099f5ef04af008 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.481125:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760779.481130:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760779.481137:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c973ad8/0x3e099f5ef04af008 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.481151:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c973ad8/0x3e099f5ef04af008 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.494629:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008c973ad8/0x3e099f5ef04af008 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.494650:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c973ad8/0x3e099f5ef04af008 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.494659:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c973ad8/0x3e099f5ef04af008 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.494666:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25953a400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760779.494671:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c973ad8/0x3e099f5ef04af008 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.494698:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c973ad8/0x3e099f5ef04af008 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.494719:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c973ad8/0x3e099f5ef04af008 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.494738:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c973ad8/0x3e099f5ef04af008 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760779.494867:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863179776:12345-192.168.203.12@tcp:3:dd.500 Request processed in 13848us (172679us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760779.494879:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 135 00000100:00100000:1.0:1789760779.494886:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 383593590779 time 383594178382 state 0x2 ref 0 00000100:00100000:3.0:1789760779.503561:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760779.503733:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863179904 00000100:00100000:0.0:1789760779.503746:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863179904 00000100:00100000:0.0:1789760779.503860:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 383593590779 time 383594178382 state 0x0 ref 1 00000100:00100000:0.0:1789760779.503877:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 383794178382 time 383594178382 state 0x1 ref 1 00000100:00100000:0.0:1789760779.681357:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 383794178382 time 383794541954 state 0x0 ref 1 00000100:00100000:0.0:1789760779.681394:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863179904:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760779.681435:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000eca1e524/0x3e099f5ef04af00f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.681450:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760779.681455:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760779.681460:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eca1e524/0x3e099f5ef04af00f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.681473:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eca1e524/0x3e099f5ef04af00f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.696384:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000eca1e524/0x3e099f5ef04af00f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.696406:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eca1e524/0x3e099f5ef04af00f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.696414:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eca1e524/0x3e099f5ef04af00f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.696422:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25953a800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760779.696426:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eca1e524/0x3e099f5ef04af00f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.696436:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eca1e524/0x3e099f5ef04af00f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.696455:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eca1e524/0x3e099f5ef04af00f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760779.696463:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eca1e524/0x3e099f5ef04af00f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760779.697238:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863179904:12345-192.168.203.12@tcp:3:dd.500 Request processed in 15855us (193687us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760779.697249:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 136 00000100:00100000:0.0:1789760779.697270:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 383794178382 time 383794541954 state 0x2 ref 0 00000100:00100000:3.0:1789760779.707970:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760779.708257:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863180032 00000100:00100000:2.0:1789760779.709149:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863180032 00000100:00100000:2.0:1789760779.709207:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 383794178382 time 383794541954 state 0x0 ref 1 00000100:00100000:2.0:1789760779.709220:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 383994541954 time 383794541954 state 0x1 ref 1 00000100:00100000:2.0:1789760779.881614:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 383994541954 time 383994788989 state 0x0 ref 1 00000100:00100000:2.0:1789760779.881653:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863180032:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760779.881696:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d3f50fff/0x3e099f5ef04af016 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.881713:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760779.881717:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760779.881724:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3f50fff/0x3e099f5ef04af016 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760779.881738:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3f50fff/0x3e099f5ef04af016 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760779.900012:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760779.900065:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760779.900101:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760779.900193:0:12460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863180416 00000100:00100000:3.0:1789760779.900204:0:12460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863180416 00000100:00100000:3.0:1789760779.900256:0:12460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 112 00000100:00100000:3.0:1789760779.900266:0:12460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25957f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1da0113a-370d-4d79-883c-54efc174697f+8:2350:x1876699863180416:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760779.900352:0:12460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25957f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1da0113a-370d-4d79-883c-54efc174697f+8:2350:x1876699863180416:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 87us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760779.900376:0:12460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 112 00000100:00100000:0.0:1789760779.901606:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863180160 00000100:00100000:0.0:1789760779.901615:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863180160 00000100:00100000:0.0:1789760779.901670:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 289 00000100:00100000:0.0:1789760779.901679:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2350:x1876699863180160:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1789760779.901736:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2350:x1876699863180160:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 57us (1734us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760779.901743:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 289 00000100:00100000:1.0:1789760779.904161:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863180288 00000100:00100000:1.0:1789760779.904173:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863180288 00000100:00100000:1.0:1789760779.904238:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 193 00000100:00100000:1.0:1789760779.904248:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25957fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+12:2350:x1876699863180288:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1789760779.904542:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25957fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+12:2350:x1876699863180288:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 294us (4438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760779.904549:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 193 00010000:00010000:1.0:1789760779.905931:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d3f50fff/0x3e099f5ef04af016 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.905950:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3f50fff/0x3e099f5ef04af016 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.905970:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3f50fff/0x3e099f5ef04af016 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.905978:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3c00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760779.905983:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3f50fff/0x3e099f5ef04af016 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.905993:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3f50fff/0x3e099f5ef04af016 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.906015:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3f50fff/0x3e099f5ef04af016 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760779.906024:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3f50fff/0x3e099f5ef04af016 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760779.906119:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863180032:12345-192.168.203.12@tcp:3:dd.500 Request processed in 24478us (198155us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760779.906128:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 137 00000100:00100000:1.0:1789760779.906136:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 383994541954 time 383994788989 state 0x2 ref 0 00000100:00100000:3.0:1789760779.906937:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760779.907101:0:12529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863180672 00000100:00100000:1.0:1789760779.907109:0:12529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863180672 00000100:00100000:1.0:1789760779.907173:0:12529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 194 00000100:00100000:1.0:1789760779.907182:0:12529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2351:x1876699863180672:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1789760779.907247:0:12529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2351:x1876699863180672:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 65us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760779.907253:0:12529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 194 00000100:00080000:3.0:1789760779.908106:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760779.908586:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760779.909957:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863180544 00000100:00100000:1.0:1789760779.909967:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863180544 00000100:00100000:1.0:1789760779.910034:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:1.0:1789760779.910056:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+5:2347:x1876699863180544:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:1.0:1789760779.910088:0:6693:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3e099f5ef04ae947 00000100:00080000:1.0:1789760779.910097:0:6693:0:(import.c:65:import_set_state_nolock()) ffff8df27ca35000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789760779.910136:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789760779.910153:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:1.0:1789760779.910247:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967346 00000100:00100000:1.0:1789760779.910574:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1da0113a-370d-4d79-883c-54efc174697f+2:2347:x1876699863180544:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 519us (1989us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760779.910582:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:3.0:1789760779.919057:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760779.919196:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863180800 00000100:00100000:1.0:1789760779.919206:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863180800 00000100:00100000:1.0:1789760779.919261:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 383994541954 time 383994788989 state 0x0 ref 1 00000100:00100000:1.0:1789760779.919273:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 384194788989 time 383994788989 state 0x1 ref 1 00000100:00100000:1.0:1789760780.081853:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 384194788989 time 384195037901 state 0x0 ref 1 00000100:00100000:1.0:1789760780.081908:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863180800:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760780.081953:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000084ac10d2/0x3e099f5ef04af01d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.081969:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789760780.081974:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760780.081996:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084ac10d2/0x3e099f5ef04af01d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.082011:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084ac10d2/0x3e099f5ef04af01d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789760780.082840:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789760780.094326:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000084ac10d2/0x3e099f5ef04af01d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.094351:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084ac10d2/0x3e099f5ef04af01d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.094359:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084ac10d2/0x3e099f5ef04af01d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.094366:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df246203e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760780.094370:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084ac10d2/0x3e099f5ef04af01d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.094379:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084ac10d2/0x3e099f5ef04af01d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.094398:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084ac10d2/0x3e099f5ef04af01d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.094405:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084ac10d2/0x3e099f5ef04af01d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760780.094509:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863180800:12345-192.168.203.12@tcp:3:dd.500 Request processed in 12634us (175465us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760780.094520:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 138 00000100:00100000:1.0:1789760780.094528:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 384194788989 time 384195037901 state 0x2 ref 0 00000100:00100000:2.0:1789760780.102853:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760780.103319:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863180928 00000100:00100000:0.0:1789760780.103330:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863180928 00000100:00100000:0.0:1789760780.103385:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 384194788989 time 384195037901 state 0x0 ref 1 00000100:00100000:0.0:1789760780.103398:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 384395037901 time 384195037901 state 0x1 ref 1 00000100:00100000:0.0:1789760780.281977:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 384395037901 time 384395160524 state 0x0 ref 1 00000100:00100000:0.0:1789760780.282017:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25957e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863180928:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760780.282071:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002b591b70/0x3e099f5ef04af024 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.282088:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.282092:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760780.282098:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b591b70/0x3e099f5ef04af024 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.282111:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b591b70/0x3e099f5ef04af024 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.297194:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002b591b70/0x3e099f5ef04af024 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.297214:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b591b70/0x3e099f5ef04af024 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.297224:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b591b70/0x3e099f5ef04af024 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.297232:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241539a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760780.297237:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b591b70/0x3e099f5ef04af024 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.297247:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b591b70/0x3e099f5ef04af024 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.297272:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b591b70/0x3e099f5ef04af024 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760780.297280:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b591b70/0x3e099f5ef04af024 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760780.297373:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25957e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863180928:12345-192.168.203.12@tcp:3:dd.500 Request processed in 15364us (194521us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760780.297383:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 139 00000100:00100000:0.0:1789760780.297405:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 384395037901 time 384395160524 state 0x2 ref 0 00000100:00100000:0.0:1789760780.306857:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760780.307281:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863181056 00000100:00100000:3.0:1789760780.307291:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863181056 00000100:00100000:3.0:1789760780.307347:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 384395037901 time 384395160524 state 0x0 ref 1 00000100:00100000:3.0:1789760780.307360:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 384595160524 time 384395160524 state 0x1 ref 1 00000100:00100000:1.0:1789760780.483463:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 384595160524 time 384596649665 state 0x0 ref 1 00000100:00100000:1.0:1789760780.483497:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863181056:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760780.483537:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000084ac10d2/0x3e099f5ef04af02b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.483554:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760780.483558:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760780.483564:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084ac10d2/0x3e099f5ef04af02b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.483577:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084ac10d2/0x3e099f5ef04af02b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.498243:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760780.502932:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000084ac10d2/0x3e099f5ef04af02b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.502952:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084ac10d2/0x3e099f5ef04af02b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.502981:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084ac10d2/0x3e099f5ef04af02b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.502989:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df246203e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760780.502994:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084ac10d2/0x3e099f5ef04af02b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.503003:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084ac10d2/0x3e099f5ef04af02b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.503024:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084ac10d2/0x3e099f5ef04af02b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.503032:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084ac10d2/0x3e099f5ef04af02b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760780.503138:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863181056:12345-192.168.203.12@tcp:3:dd.500 Request processed in 19654us (196285us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760780.503149:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 140 00000100:00100000:1.0:1789760780.503157:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 384595160524 time 384596649665 state 0x2 ref 0 00000100:00100000:3.0:1789760780.513699:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760780.513864:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863181184 00000100:00100000:1.0:1789760780.513874:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863181184 00000100:00100000:1.0:1789760780.513941:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 384595160524 time 384596649665 state 0x0 ref 1 00000100:00100000:1.0:1789760780.513953:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 384796649665 time 384596649665 state 0x1 ref 1 00000100:00100000:1.0:1789760780.684007:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 384796649665 time 384797190416 state 0x0 ref 1 00000100:00100000:1.0:1789760780.684054:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863181184:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760780.684100:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000084ac10d2/0x3e099f5ef04af032 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.684118:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760780.684122:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760780.684129:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084ac10d2/0x3e099f5ef04af032 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760780.684144:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084ac10d2/0x3e099f5ef04af032 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.697975:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000084ac10d2/0x3e099f5ef04af032 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.698029:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084ac10d2/0x3e099f5ef04af032 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.698048:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084ac10d2/0x3e099f5ef04af032 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.698063:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df246203e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760780.698068:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084ac10d2/0x3e099f5ef04af032 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.698079:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084ac10d2/0x3e099f5ef04af032 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.698100:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084ac10d2/0x3e099f5ef04af032 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.698108:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084ac10d2/0x3e099f5ef04af032 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760780.698786:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863181184:12345-192.168.203.12@tcp:3:dd.500 Request processed in 14755us (185090us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760780.698799:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 141 00000100:00100000:2.0:1789760780.698856:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 384796649665 time 384797190416 state 0x2 ref 0 00000100:00100000:3.0:1789760780.709798:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760780.710144:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863181312 00000100:00100000:1.0:1789760780.710156:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863181312 00000100:00100000:1.0:1789760780.710210:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 384796649665 time 384797190416 state 0x0 ref 1 00000100:00100000:1.0:1789760780.710225:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 384997190416 time 384797190416 state 0x1 ref 1 00000100:00100000:0.0:1789760780.879394:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2687d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883062784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789760780.879469:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760780.879717:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883062784 00000100:00100000:3.0:1789760780.879726:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883062784 00000100:00100000:3.0:1789760780.879797:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789760780.879832:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883062784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760780.879865:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241893376 pending 0 free 3754950656 avail 3752853504 00000100:00100000:3.0:1789760780.879906:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883062784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760780.879913:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1789760780.880061:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760780.880448:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2687d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883062784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760780.884682:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 384997190416 time 384997868459 state 0x0 ref 1 00000100:00100000:2.0:1789760780.884717:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863181312:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760780.884756:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04af039 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.884774:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760780.884779:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760780.884786:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04af039 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.884903:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04af039 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.893477:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04af039 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.893501:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04af039 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.893509:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04af039 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.893518:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760780.893523:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04af039 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.893532:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04af039 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.893563:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04af039 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760780.893571:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001436f204/0x3e099f5ef04af039 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760780.893784:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863181312:12345-192.168.203.12@tcp:3:dd.500 Request processed in 9072us (183990us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760780.893796:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 142 00000100:00100000:2.0:1789760780.893825:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 384997190416 time 384997868459 state 0x2 ref 0 00000100:00100000:3.0:1789760780.900967:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760780.901066:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863181440 00000100:00100000:0.0:1789760780.901077:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863181440 00000100:00100000:0.0:1789760780.901205:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 384997190416 time 384997868459 state 0x0 ref 1 00000100:00100000:0.0:1789760780.901218:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 385197868459 time 384997868459 state 0x1 ref 1 00000001:00080000:2.0:1789760780.924410:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000100:00100000:1.0:1789760781.084881:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 385197868459 time 385198064800 state 0x0 ref 1 00000100:00100000:1.0:1789760781.084914:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863181440:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760781.084969:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000de8e46ea/0x3e099f5ef04af040 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.084988:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789760781.085005:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760781.085013:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de8e46ea/0x3e099f5ef04af040 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.085028:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de8e46ea/0x3e099f5ef04af040 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.095610:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000de8e46ea/0x3e099f5ef04af040 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.095632:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de8e46ea/0x3e099f5ef04af040 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.095641:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de8e46ea/0x3e099f5ef04af040 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.095649:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df258e06e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760781.095655:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de8e46ea/0x3e099f5ef04af040 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.095664:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de8e46ea/0x3e099f5ef04af040 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.095683:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de8e46ea/0x3e099f5ef04af040 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.095691:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de8e46ea/0x3e099f5ef04af040 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760781.095796:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863181440:12345-192.168.203.12@tcp:3:dd.500 Request processed in 10892us (194835us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760781.095858:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 143 00000100:00100000:1.0:1789760781.095867:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 385197868459 time 385198064800 state 0x2 ref 0 00000100:00100000:0.0:1789760781.101326:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760781.101449:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863181568 00000100:00100000:1.0:1789760781.101458:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863181568 00000100:00100000:1.0:1789760781.101505:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 385197868459 time 385198064800 state 0x0 ref 1 00000100:00100000:1.0:1789760781.101518:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 385398064800 time 385198064800 state 0x1 ref 1 00000100:00100000:2.0:1789760781.285451:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 385398064800 time 385398634745 state 0x0 ref 1 00000100:00100000:2.0:1789760781.285487:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863181568:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760781.285530:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af047 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.285547:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760781.285551:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760781.285557:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af047 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.285571:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af047 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.308065:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af047 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.308084:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af047 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.308092:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af047 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.308099:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df247ee2a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760781.308103:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af047 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.308112:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af047 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.308130:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af047 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.308138:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af047 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760781.308228:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863181568:12345-192.168.203.12@tcp:3:dd.500 Request processed in 22752us (206907us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760781.308240:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 144 00000100:00100000:2.0:1789760781.308266:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 385398064800 time 385398634745 state 0x2 ref 0 00000100:00100000:2.0:1789760781.318077:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760781.318267:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863181696 00000100:00100000:1.0:1789760781.318278:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863181696 00000100:00100000:1.0:1789760781.318332:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 385398064800 time 385398634745 state 0x0 ref 1 00000100:00100000:1.0:1789760781.318345:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 385598634745 time 385398634745 state 0x1 ref 1 00000100:00100000:2.0:1789760781.486301:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 385598634745 time 385599487110 state 0x0 ref 1 00000100:00100000:2.0:1789760781.486334:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25957dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863181696:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760781.486375:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af04e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.486393:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760781.486397:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760781.486404:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af04e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.486417:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af04e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.513104:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af04e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.513124:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af04e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.513134:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af04e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.513141:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df247ee2a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760781.513145:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af04e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.513180:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af04e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.513207:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af04e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.513215:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af04e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760781.513307:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25957dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863181696:12345-192.168.203.12@tcp:3:dd.500 Request processed in 26984us (195233us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760781.513317:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 145 00000100:00100000:2.0:1789760781.513324:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 385598634745 time 385599487110 state 0x2 ref 0 00000100:00100000:2.0:1789760781.518946:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760781.519090:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863181824 00000100:00100000:0.0:1789760781.519100:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863181824 00000100:00100000:0.0:1789760781.519151:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 385598634745 time 385599487110 state 0x0 ref 1 00000100:00100000:0.0:1789760781.519164:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 385799487110 time 385599487110 state 0x1 ref 1 00010000:00010000:0.0:1789760781.519232:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760781.686457:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 385799487110 time 385799642516 state 0x0 ref 1 00000100:00100000:1.0:1789760781.686489:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df25957d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863181824:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760781.686527:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000de8e46ea/0x3e099f5ef04af055 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.686543:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760781.686559:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760781.686566:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de8e46ea/0x3e099f5ef04af055 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.686597:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de8e46ea/0x3e099f5ef04af055 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.701204:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000de8e46ea/0x3e099f5ef04af055 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.701223:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de8e46ea/0x3e099f5ef04af055 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.701232:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de8e46ea/0x3e099f5ef04af055 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.701240:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df258e06e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760781.701250:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de8e46ea/0x3e099f5ef04af055 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.701259:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de8e46ea/0x3e099f5ef04af055 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.701279:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de8e46ea/0x3e099f5ef04af055 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760781.701287:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de8e46ea/0x3e099f5ef04af055 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760781.701395:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df25957d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863181824:12345-192.168.203.12@tcp:3:dd.500 Request processed in 14916us (182454us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760781.701406:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 146 00000100:00100000:1.0:1789760781.701413:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 385799487110 time 385799642516 state 0x2 ref 0 00000100:00100000:2.0:1789760781.706579:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760781.706660:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863181952 00000100:00100000:1.0:1789760781.706670:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863181952 00000100:00100000:1.0:1789760781.706725:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 385799487110 time 385799642516 state 0x0 ref 1 00000100:00100000:1.0:1789760781.706738:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 385999642516 time 385799642516 state 0x1 ref 1 00000100:00100000:2.0:1789760781.886609:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 385999642516 time 385999794694 state 0x0 ref 1 00000100:00100000:2.0:1789760781.886642:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863181952:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760781.886684:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af05c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.886700:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760781.886705:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760781.886712:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af05c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.887197:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af05c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.913707:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af05c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.913729:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af05c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.913738:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af05c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.913745:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df247ee2a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760781.913750:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af05c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.913759:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af05c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.913781:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af05c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760781.913789:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af05c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760781.913964:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863181952:12345-192.168.203.12@tcp:3:dd.500 Request processed in 27333us (207390us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760781.913975:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 147 00000100:00100000:2.0:1789760781.913982:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 385999642516 time 385999794694 state 0x2 ref 0 00000100:00100000:2.0:1789760781.921282:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760781.921663:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863182080 00000100:00100000:0.0:1789760781.921673:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863182080 00000100:00100000:0.0:1789760781.921797:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 385999642516 time 385999794694 state 0x0 ref 1 00000100:00100000:0.0:1789760781.921851:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 386199794694 time 385999794694 state 0x1 ref 1 00000100:00100000:2.0:1789760782.089141:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 386199794694 time 386202327386 state 0x0 ref 1 00000100:00100000:2.0:1789760782.089191:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863182080:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760782.089231:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af063 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.089248:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789760782.089253:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760782.089259:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af063 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.089273:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af063 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789760782.089338:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789760782.134731:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af063 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.134752:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af063 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.134775:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af063 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.134783:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df247ee2a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760782.134788:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af063 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.134797:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af063 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.134859:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af063 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.134867:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052c60ad9/0x3e099f5ef04af063 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760782.134951:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863182080:12345-192.168.203.12@tcp:3:dd.500 Request processed in 45789us (213675us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760782.134962:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 148 00000100:00100000:0.0:1789760782.134970:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 386199794694 time 386202327386 state 0x2 ref 0 00000100:00100000:0.0:1789760782.142840:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760782.142985:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863182208 00000100:00100000:3.0:1789760782.142995:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863182208 00000100:00100000:3.0:1789760782.143058:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 386199794694 time 386202327386 state 0x0 ref 1 00000100:00100000:3.0:1789760782.143088:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 386402327386 time 386202327386 state 0x1 ref 1 00000100:00100000:1.0:1789760782.289374:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 386402327386 time 386402557823 state 0x0 ref 1 00000100:00100000:1.0:1789760782.289407:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df259bdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863182208:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760782.289502:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c44af9cd/0x3e099f5ef04af06a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.289520:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.289524:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.289530:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c44af9cd/0x3e099f5ef04af06a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.289544:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c44af9cd/0x3e099f5ef04af06a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.302111:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c44af9cd/0x3e099f5ef04af06a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.302144:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c44af9cd/0x3e099f5ef04af06a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.302152:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c44af9cd/0x3e099f5ef04af06a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.302159:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241674200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760782.302164:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c44af9cd/0x3e099f5ef04af06a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.302436:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c44af9cd/0x3e099f5ef04af06a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.302456:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c44af9cd/0x3e099f5ef04af06a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.302464:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c44af9cd/0x3e099f5ef04af06a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.302550:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df259bdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863182208:12345-192.168.203.12@tcp:3:dd.500 Request processed in 13153us (159715us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760782.302560:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 149 00000100:00100000:1.0:1789760782.302571:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 386402327386 time 386402557823 state 0x2 ref 0 00000100:00100000:2.0:1789760782.309399:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760782.310636:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863182336 00000100:00100000:1.0:1789760782.310667:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863182336 00000100:00100000:1.0:1789760782.310725:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 386402327386 time 386402557823 state 0x0 ref 1 00000100:00100000:1.0:1789760782.310738:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 386602557823 time 386402557823 state 0x1 ref 1 00000100:00100000:2.0:1789760782.417613:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883063168:0@lo:400:kworker.0 00000100:00100000:0.0:1789760782.417637:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2687d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883062912:0@lo:400:kworker.0 00000100:00100000:1.0:1789760782.417702:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2687dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883063040:0@lo:400:kworker.0 00000100:00100000:2.0:1789760782.419722:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760782.419766:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883063296:0@lo:400:kworker.0 00000100:00100000:2.0:1789760782.419892:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760782.419957:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883063552:0@lo:400:kworker.0 00000100:00100000:2.0:1789760782.420007:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760782.420051:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883063552 00000100:00100000:2.0:1789760782.420058:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883063552 00000100:00100000:2.0:1789760782.420110:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789760782.420119:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883063552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760782.420169:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883063552:12345-0@lo:400:kworker.0 Request processed in 50us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760782.420176:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:2.0:1789760782.420195:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789760782.420223:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883063552:0@lo:400:kworker.0 00000100:00100000:3.0:1789760782.420334:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883063168 00000100:00100000:3.0:1789760782.420340:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883063168 00000100:00100000:3.0:1789760782.420375:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883063040 00000100:00100000:3.0:1789760782.420378:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883063040 00000100:00100000:3.0:1789760782.420397:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1789760782.420404:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883063168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760782.420442:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883063168:12345-0@lo:400:kworker.0 Request processed in 38us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760782.420448:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1789760782.420460:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1789760782.420466:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883063040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760782.420495:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883063040:12345-0@lo:400:kworker.0 Request processed in 29us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760782.420501:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:3.0:1789760782.420525:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760782.420542:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883063168:0@lo:400:kworker.0 00000100:00100000:3.0:1789760782.420582:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2687dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883063040:0@lo:400:kworker.0 00000100:00100000:0.0:1789760782.420754:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760782.420793:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1876699883063424:0@lo:400:kworker.0 00000100:00100000:2.0:1789760782.420877:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883062912 00000100:00100000:2.0:1789760782.420882:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883062912 00000100:00100000:0.0:1789760782.420990:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760782.421049:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883063424 00000100:00100000:0.0:1789760782.421053:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883063424 00000100:00100000:0.0:1789760782.421082:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789760782.421087:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876699883063424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760782.421119:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876699883063424:12345-0@lo:400:kworker.0 Request processed in 32us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760782.421125:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:0.0:1789760782.421139:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760782.421158:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1876699883063424:0@lo:400:kworker.0 00000100:00100000:2.0:1789760782.421250:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1789760782.421258:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883062912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789760782.421301:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883062912:12345-0@lo:400:kworker.0 Request processed in 44us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760782.421307:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1789760782.421368:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2687d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883062912:0@lo:400:kworker.0 00000100:00100000:1.0:1789760782.421506:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760782.421653:0:12460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883063296 00000100:00100000:3.0:1789760782.421658:0:12460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883063296 00000100:00100000:3.0:1789760782.421766:0:12460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789760782.421774:0:12460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24626df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883063296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760782.421834:0:12460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24626df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883063296:12345-0@lo:400:kworker.0 Request processed in 61us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760782.421840:0:12460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789760782.421897:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883063296:0@lo:400:kworker.0 00000100:00080000:0.0:1789760782.421963:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760782.491054:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 386602557823 time 386604238766 state 0x0 ref 1 00000100:00100000:2.0:1789760782.491090:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863182336:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760782.491133:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000174b77b6/0x3e099f5ef04af071 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.491149:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760782.491153:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760782.491172:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000174b77b6/0x3e099f5ef04af071 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.491186:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000174b77b6/0x3e099f5ef04af071 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.510214:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000174b77b6/0x3e099f5ef04af071 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.510234:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000174b77b6/0x3e099f5ef04af071 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.510243:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000174b77b6/0x3e099f5ef04af071 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.510248:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df277dbee00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760782.510251:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000174b77b6/0x3e099f5ef04af071 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.510257:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000174b77b6/0x3e099f5ef04af071 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.510272:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000174b77b6/0x3e099f5ef04af071 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.510276:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000174b77b6/0x3e099f5ef04af071 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760782.510363:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863182336:12345-192.168.203.12@tcp:3:dd.500 Request processed in 19288us (200971us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760782.510371:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 150 00000100:00100000:1.0:1789760782.510377:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 386602557823 time 386604238766 state 0x2 ref 0 00000100:00100000:0.0:1789760782.523222:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760782.523580:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863182464 00000100:00100000:2.0:1789760782.523592:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863182464 00000100:00100000:2.0:1789760782.523647:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 386602557823 time 386604238766 state 0x0 ref 1 00000100:00100000:2.0:1789760782.523659:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 386804238766 time 386604238766 state 0x1 ref 1 00010000:00010000:2.0:1789760782.544659:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760782.693778:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 386804238766 time 386806963500 state 0x0 ref 1 00000100:00100000:0.0:1789760782.693852:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863182464:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760782.693897:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004f9cd1a8/0x3e099f5ef04af078 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.693914:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760782.693918:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760782.693924:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f9cd1a8/0x3e099f5ef04af078 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760782.694119:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f9cd1a8/0x3e099f5ef04af078 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.718883:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004f9cd1a8/0x3e099f5ef04af078 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.718909:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f9cd1a8/0x3e099f5ef04af078 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.718919:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f9cd1a8/0x3e099f5ef04af078 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.718928:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df246203200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760782.718938:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f9cd1a8/0x3e099f5ef04af078 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.718949:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f9cd1a8/0x3e099f5ef04af078 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.718974:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f9cd1a8/0x3e099f5ef04af078 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760782.718984:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f9cd1a8/0x3e099f5ef04af078 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760782.719140:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863182464:12345-192.168.203.12@tcp:3:dd.500 Request processed in 25338us (195919us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760782.719152:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 151 00000100:00100000:3.0:1789760782.719161:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 386804238766 time 386806963500 state 0x2 ref 0 00000100:00100000:0.0:1789760782.726181:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760782.726302:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863182592 00000100:00100000:2.0:1789760782.726315:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863182592 00000100:00100000:2.0:1789760782.726399:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 386804238766 time 386806963500 state 0x0 ref 1 00000100:00100000:2.0:1789760782.726415:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 387006963500 time 386806963500 state 0x1 ref 1 00000100:00100000:1.0:1789760782.893982:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 387006963500 time 387007167094 state 0x0 ref 1 00000100:00100000:1.0:1789760782.894028:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863182592:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760782.894073:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04af07f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.894091:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789760782.894096:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760782.894103:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04af07f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760782.894119:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04af07f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.907571:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04af07f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.907595:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04af07f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.907606:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04af07f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.907616:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241675400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760782.907622:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04af07f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.907653:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04af07f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.907677:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04af07f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760782.907686:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04af07f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760782.907789:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863182592:12345-192.168.203.12@tcp:3:dd.500 Request processed in 13783us (181619us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760782.907836:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 152 00000100:00100000:2.0:1789760782.907847:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 387006963500 time 387007167094 state 0x2 ref 0 00000100:00100000:1.0:1789760782.916663:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760782.916772:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863182720 00000100:00100000:0.0:1789760782.916783:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863182720 00000100:00100000:0.0:1789760782.916873:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 387006963500 time 387007167094 state 0x0 ref 1 00000100:00100000:0.0:1789760782.916886:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 387207167094 time 387007167094 state 0x1 ref 1 00000100:00100000:2.0:1789760782.929165:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789760782.929188:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2687dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883063680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760782.929256:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760782.931633:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883063680 00000100:00100000:0.0:1789760782.931647:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883063680 00000100:00100000:0.0:1789760782.931717:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789760782.931727:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883063680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789760782.931774:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760782.931886:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883063680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (2628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760782.931893:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789760782.932122:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2687dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883063680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789760783.094158:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 387207167094 time 387207341787 state 0x0 ref 1 00000100:00100000:1.0:1789760783.094193:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24626e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863182720:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760783.094246:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04af086 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.094281:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760783.094286:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760783.094292:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04af086 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.094306:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04af086 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.105594:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04af086 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.105613:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04af086 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.105621:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04af086 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.105638:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241675400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760783.105643:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04af086 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.105650:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04af086 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.105670:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04af086 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.105677:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2a8e93b/0x3e099f5ef04af086 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.105758:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24626e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863182720:12345-192.168.203.12@tcp:3:dd.500 Request processed in 11578us (189100us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760783.105769:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 153 00000100:00100000:2.0:1789760783.105777:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 387207167094 time 387207341787 state 0x2 ref 0 00000100:00100000:0.0:1789760783.111077:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760783.111150:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863182848 00000100:00100000:2.0:1789760783.111162:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863182848 00000100:00100000:2.0:1789760783.111223:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 387207167094 time 387207341787 state 0x0 ref 1 00000100:00100000:2.0:1789760783.111234:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 387407341787 time 387207341787 state 0x1 ref 1 00000100:00100000:3.0:1789760783.294296:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 387407341787 time 387407481238 state 0x0 ref 1 00000100:00100000:3.0:1789760783.294342:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863182848:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:3.0:1789760783.294392:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af08d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.294407:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760783.294411:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760783.294417:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af08d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.294431:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af08d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.310494:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af08d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.310579:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af08d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.310591:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af08d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.310599:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df247ee9800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760783.310604:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af08d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.310614:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af08d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.310650:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af08d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.310659:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af08d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760783.312395:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863182848:12345-192.168.203.12@tcp:3:dd.500 Request processed in 16467us (199728us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760783.312414:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 154 00000100:00100000:3.0:1789760783.312422:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 387407341787 time 387407481238 state 0x2 ref 0 00000100:00100000:0.0:1789760783.318328:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760783.318379:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863182976 00000100:00100000:2.0:1789760783.318389:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863182976 00000100:00100000:2.0:1789760783.318490:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 387407341787 time 387407481238 state 0x0 ref 1 00000100:00100000:2.0:1789760783.318515:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 387607481238 time 387407481238 state 0x1 ref 1 00000100:00100000:2.0:1789760783.494690:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 387607481238 time 387607875094 state 0x0 ref 1 00000100:00100000:2.0:1789760783.494736:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863182976:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760783.494780:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04af094 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.494797:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.494827:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.494835:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04af094 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.494850:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04af094 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.511690:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04af094 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.511781:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04af094 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.511791:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04af094 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.511799:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760783.511840:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04af094 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.511864:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04af094 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.511884:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04af094 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.511892:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04af094 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.512281:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863182976:12345-192.168.203.12@tcp:3:dd.500 Request processed in 17558us (193956us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760783.512291:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 155 00000100:00100000:2.0:1789760783.512298:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 387607481238 time 387607875094 state 0x2 ref 0 00000100:00100000:1.0:1789760783.522878:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760783.522966:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863183104 00000100:00100000:0.0:1789760783.522975:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863183104 00000100:00100000:0.0:1789760783.523043:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 387607481238 time 387607875094 state 0x0 ref 1 00000100:00100000:0.0:1789760783.523055:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 387807875094 time 387607875094 state 0x1 ref 1 00010000:00010000:1.0:1789760783.567551:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760783.695328:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 387807875094 time 387808514845 state 0x0 ref 1 00000100:00100000:2.0:1789760783.695370:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24626d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863183104:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760783.695413:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04af09b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.695430:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.695434:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760783.695440:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04af09b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.695471:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04af09b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.707738:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04af09b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.707769:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04af09b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.707778:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04af09b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.707785:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760783.707790:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04af09b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.707799:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04af09b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.707845:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04af09b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.707853:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04af09b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.707976:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24626d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863183104:12345-192.168.203.12@tcp:3:dd.500 Request processed in 12624us (185102us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760783.707987:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 156 00000100:00100000:2.0:1789760783.707995:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 387807875094 time 387808514845 state 0x2 ref 0 00000100:00100000:0.0:1789760783.719518:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760783.719611:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863183232 00000100:00100000:2.0:1789760783.719622:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863183232 00000100:00100000:2.0:1789760783.719676:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 387807875094 time 387808514845 state 0x0 ref 1 00000100:00100000:2.0:1789760783.719689:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 388008514845 time 387808514845 state 0x1 ref 1 00000100:00100000:3.0:1789760783.895500:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 388008514845 time 388008685176 state 0x0 ref 1 00000100:00100000:3.0:1789760783.895534:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863183232:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:3.0:1789760783.895588:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af0a2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.895607:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789760783.895611:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760783.895618:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af0a2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.895634:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af0a2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.909413:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af0a2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.909435:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af0a2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.909445:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af0a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.909452:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df247ee9800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760783.909457:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af0a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.909465:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af0a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.909486:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af0a2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.909493:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af0a2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760783.909576:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863183232:12345-192.168.203.12@tcp:3:dd.500 Request processed in 14054us (190065us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760783.909586:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 157 00000100:00100000:3.0:1789760783.909605:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 388008514845 time 388008685176 state 0x2 ref 0 00000100:00100000:2.0:1789760783.914866:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760783.914951:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863183360 00000100:00100000:3.0:1789760783.914960:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863183360 00000100:00100000:3.0:1789760783.915020:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 388008514845 time 388008685176 state 0x0 ref 1 00000100:00100000:3.0:1789760783.915033:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 388208685176 time 388008685176 state 0x1 ref 1 00000100:00100000:2.0:1789760784.095854:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 388208685176 time 388209040790 state 0x0 ref 1 00000100:00100000:2.0:1789760784.095899:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863183360:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760784.095937:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04af0a9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.095953:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760784.095957:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760784.095963:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04af0a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.095976:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04af0a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789760784.096684:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789760784.103160:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04af0a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.103179:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04af0a9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.103187:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04af0a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.103195:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760784.103200:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04af0a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.103209:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04af0a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.103334:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04af0a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.103343:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000353aab65/0x3e099f5ef04af0a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760784.103441:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863183360:12345-192.168.203.12@tcp:3:dd.500 Request processed in 7567us (188581us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760784.103451:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 158 00000100:00100000:3.0:1789760784.103460:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 388208685176 time 388209040790 state 0x2 ref 0 00000100:00100000:2.0:1789760784.113902:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760784.114071:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863183488 00000100:00100000:0.0:1789760784.114081:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863183488 00000100:00100000:0.0:1789760784.114143:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 388208685176 time 388209040790 state 0x0 ref 1 00000100:00100000:0.0:1789760784.114170:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 388409040790 time 388209040790 state 0x1 ref 1 00000100:00100000:2.0:1789760784.296229:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 388409040790 time 388409415216 state 0x0 ref 1 00000100:00100000:2.0:1789760784.296261:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863183488:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760784.296314:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04af0b0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.296332:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760784.296337:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760784.296343:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04af0b0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760784.296356:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04af0b0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.303350:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04af0b0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.303370:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04af0b0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.303380:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04af0b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.303388:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a66e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760784.303394:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04af0b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.303403:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04af0b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.303452:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04af0b0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.303460:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c316ce0/0x3e099f5ef04af0b0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760784.303640:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863183488:12345-192.168.203.12@tcp:3:dd.500 Request processed in 7389us (189744us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760784.303651:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 159 00000100:00100000:1.0:1789760784.303659:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 388409040790 time 388409415216 state 0x2 ref 0 00000100:00100000:0.0:1789760784.317867:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760784.317969:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863183616 00000100:00100000:2.0:1789760784.317981:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863183616 00000100:00100000:2.0:1789760784.318041:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 388409040790 time 388409415216 state 0x0 ref 1 00000100:00100000:2.0:1789760784.318054:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 388609415216 time 388409415216 state 0x1 ref 1 00000100:00100000:3.0:1789760784.496572:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 388609415216 time 388609757597 state 0x0 ref 1 00000100:00100000:3.0:1789760784.496606:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863183616:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:3.0:1789760784.496647:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af0b7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.496663:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760784.496668:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760784.496674:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af0b7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.496688:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af0b7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.509919:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af0b7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.509937:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af0b7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.509964:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af0b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.509971:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df247ee9800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760784.509976:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af0b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.509985:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af0b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.510012:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af0b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.510020:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af0b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760784.510106:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863183616:12345-192.168.203.12@tcp:3:dd.500 Request processed in 13512us (192244us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760784.510117:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 160 00000100:00100000:3.0:1789760784.510126:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 388609415216 time 388609757597 state 0x2 ref 0 00000100:00100000:2.0:1789760784.519974:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760784.520055:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863183744 00000100:00100000:3.0:1789760784.520065:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863183744 00000100:00100000:3.0:1789760784.520117:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 388609415216 time 388609757597 state 0x0 ref 1 00000100:00100000:3.0:1789760784.520129:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 388809757597 time 388609757597 state 0x1 ref 1 00010000:00010000:0.0:1789760784.590960:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760784.696659:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 388809757597 time 388809840153 state 0x0 ref 1 00000100:00100000:3.0:1789760784.696744:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863183744:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:3.0:1789760784.696784:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af0be lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.696946:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760784.696950:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760784.696957:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af0be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760784.696972:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af0be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.707290:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af0be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.707322:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af0be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.707330:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af0be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.707341:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df247ee9800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760784.707346:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af0be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.707354:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af0be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.707390:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af0be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.707398:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d39a912/0x3e099f5ef04af0be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760784.707478:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863183744:12345-192.168.203.12@tcp:3:dd.500 Request processed in 10796us (187507us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760784.707489:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 161 00000100:00100000:1.0:1789760784.707497:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 388809757597 time 388809840153 state 0x2 ref 0 00000100:00100000:0.0:1789760784.716650:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760784.716850:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863183872 00000100:00100000:1.0:1789760784.716863:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863183872 00000100:00100000:1.0:1789760784.716922:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 388809757597 time 388809840153 state 0x0 ref 1 00000100:00100000:1.0:1789760784.716935:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 389009840153 time 388809840153 state 0x1 ref 1 00000100:00100000:1.0:1789760784.896773:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 389009840153 time 389009957519 state 0x0 ref 1 00000100:00100000:1.0:1789760784.896851:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863183872:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760784.896895:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c05d2467/0x3e099f5ef04af0c5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.896917:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789760784.896921:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760784.896927:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c05d2467/0x3e099f5ef04af0c5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.896962:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c05d2467/0x3e099f5ef04af0c5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.908593:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c05d2467/0x3e099f5ef04af0c5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.908613:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c05d2467/0x3e099f5ef04af0c5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.908623:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c05d2467/0x3e099f5ef04af0c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.908629:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2450b8a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760784.908634:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c05d2467/0x3e099f5ef04af0c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.908642:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c05d2467/0x3e099f5ef04af0c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.908660:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c05d2467/0x3e099f5ef04af0c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760784.908668:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c05d2467/0x3e099f5ef04af0c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760784.908768:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863183872:12345-192.168.203.12@tcp:3:dd.500 Request processed in 11972us (192122us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760784.908779:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 162 00000100:00100000:1.0:1789760784.908787:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 389009840153 time 389009957519 state 0x2 ref 0 00000100:00100000:1.0:1789760784.912538:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760784.912661:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863184000 00000100:00100000:2.0:1789760784.912673:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863184000 00000100:00100000:2.0:1789760784.912794:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 389009840153 time 389009957519 state 0x0 ref 1 00000100:00100000:2.0:1789760784.912895:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 389209957519 time 389009957519 state 0x1 ref 1 00000100:00100000:2.0:1789760785.013734:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760785.013775:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760785.013878:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760785.014246:0:12529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863184256 00000100:00100000:3.0:1789760785.014257:0:12529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863184256 00000100:00100000:3.0:1789760785.014328:0:12529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863184384 00000100:00100000:3.0:1789760785.014332:0:12529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863184384 00000100:00100000:3.0:1789760785.014360:0:12529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 198 00000100:00100000:3.0:1789760785.014371:0:12529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1da0113a-370d-4d79-883c-54efc174697f+9:2348:x1876699863184256:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760785.014448:0:12529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1da0113a-370d-4d79-883c-54efc174697f+9:2348:x1876699863184256:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 79us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760785.014455:0:12529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 198 00000100:00100000:3.0:1789760785.014470:0:12529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 199 00000100:00100000:3.0:1789760785.014476:0:12529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2348:x1876699863184384:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760785.014499:0:12529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2348:x1876699863184384:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760785.014521:0:12529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 199 00000100:00100000:3.0:1789760785.014541:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863184128 00000100:00100000:3.0:1789760785.014544:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863184128 00000100:00100000:3.0:1789760785.014568:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 291 00000100:00100000:3.0:1789760785.014574:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2348:x1876699863184128:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760785.014600:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2348:x1876699863184128:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760785.014606:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 291 00000100:00080000:2.0:1789760785.016264:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1789760785.028172:0:7658:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1da0113a-370d-4d79-883c-54efc174697f 00000020:00000080:1.0:1789760785.028181:0:7658:0:(genops.c:885:class_export_put()) final put ffff8df27ca36000/1da0113a-370d-4d79-883c-54efc174697f 00000020:00000080:0.0:1789760785.028311:0:477:0:(genops.c:844:class_export_destroy()) destroying export ffff8df27ca36000/1da0113a-370d-4d79-883c-54efc174697f for lustre-OST0001 00000020:00000080:0.0:1789760785.028365:0:477:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df27ca35000 for lustre-OST0001 00000100:00100000:3.0:1789760785.096997:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 389209957519 time 389210181757 state 0x0 ref 1 00000100:00100000:3.0:1789760785.097106:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24626ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863184000:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:3.0:1789760785.097152:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ddcfe23d/0x3e099f5ef04af0cc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.097169:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760785.097173:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760785.097179:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddcfe23d/0x3e099f5ef04af0cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760785.097193:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddcfe23d/0x3e099f5ef04af0cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.132707:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ddcfe23d/0x3e099f5ef04af0cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.132726:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddcfe23d/0x3e099f5ef04af0cc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.132735:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddcfe23d/0x3e099f5ef04af0cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.132741:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df247ee8800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760785.132746:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddcfe23d/0x3e099f5ef04af0cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.132753:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddcfe23d/0x3e099f5ef04af0cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.132772:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddcfe23d/0x3e099f5ef04af0cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.132779:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddcfe23d/0x3e099f5ef04af0cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760785.132911:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24626ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863184000:12345-192.168.203.12@tcp:3:dd.500 Request processed in 35883us (220379us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760785.132921:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 163 00000100:00100000:0.0:1789760785.132929:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 389209957519 time 389210181757 state 0x2 ref 0 00000100:00100000:3.0:1789760785.150173:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760785.150298:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863184512 00000100:00100000:0.0:1789760785.150309:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863184512 00000100:00100000:0.0:1789760785.150361:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 389209957519 time 389210181757 state 0x0 ref 1 00000100:00100000:0.0:1789760785.150374:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 389410181757 time 389210181757 state 0x1 ref 1 00000100:00100000:1.0:1789760785.297532:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 389410181757 time 389410717212 state 0x0 ref 1 00000100:00100000:1.0:1789760785.297566:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863184512:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760785.297619:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002b591b70/0x3e099f5ef04af0d3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.297637:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760785.297642:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760785.297649:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b591b70/0x3e099f5ef04af0d3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.297664:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b591b70/0x3e099f5ef04af0d3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.309474:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002b591b70/0x3e099f5ef04af0d3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.309501:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b591b70/0x3e099f5ef04af0d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.309511:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b591b70/0x3e099f5ef04af0d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.309521:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241539a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760785.309526:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b591b70/0x3e099f5ef04af0d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.309535:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b591b70/0x3e099f5ef04af0d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.309554:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b591b70/0x3e099f5ef04af0d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.309561:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b591b70/0x3e099f5ef04af0d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [33554432->34603007] (req 33554432->34603007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760785.309948:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863184512:12345-192.168.203.12@tcp:3:dd.500 Request processed in 12394us (159778us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760785.310210:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 164 00000100:00100000:2.0:1789760785.310232:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 389410181757 time 389410717212 state 0x2 ref 0 00000100:00100000:3.0:1789760785.321963:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760785.324448:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863184640 00000100:00100000:1.0:1789760785.324465:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863184640 00000100:00100000:1.0:1789760785.324532:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 389410181757 time 389410717212 state 0x0 ref 1 00000100:00100000:1.0:1789760785.324562:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 389610717212 time 389410717212 state 0x1 ref 1 00000100:00100000:1.0:1789760785.497789:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 389610717212 time 389610975269 state 0x0 ref 1 00000100:00100000:1.0:1789760785.497846:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863184640:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760785.497890:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af0da lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.497908:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760785.497912:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760785.497918:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af0da lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.497931:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af0da lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.507891:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af0da lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.507914:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af0da lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.507926:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af0da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.507934:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241538000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760785.507940:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af0da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.507966:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af0da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.507995:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af0da lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760785.508021:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af0da lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [34603008->35651583] (req 34603008->35651583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760785.508100:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863184640:12345-192.168.203.12@tcp:3:dd.500 Request processed in 10266us (186141us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760785.508111:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 165 00000100:00100000:1.0:1789760785.508120:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 389610717212 time 389610975269 state 0x2 ref 0 00000100:00100000:3.0:1789760785.523969:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760785.524088:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863184768 00000100:00100000:2.0:1789760785.524099:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863184768 00000100:00100000:2.0:1789760785.524160:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 389610717212 time 389610975269 state 0x0 ref 1 00000100:00100000:2.0:1789760785.524173:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 389810975269 time 389610975269 state 0x1 ref 1 00010000:00010000:2.0:1789760785.615111:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760785.698011:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 389810975269 time 389811183857 state 0x0 ref 1 00000100:00100000:0.0:1789760785.699524:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863184768:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760785.699572:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af0e1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.699589:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760785.699594:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760785.699601:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af0e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.699614:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af0e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.719283:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af0e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.719319:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af0e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.719327:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af0e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.719333:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df259bd3000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760785.719338:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af0e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.719346:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af0e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.719365:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af0e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760785.719374:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af0e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [35651584->36700159] (req 35651584->36700159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760785.719609:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863184768:12345-192.168.203.12@tcp:3:dd.500 Request processed in 21574us (195645us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760785.719621:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 166 00000100:00100000:0.0:1789760785.719629:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 389810975269 time 389811183857 state 0x2 ref 0 00000100:00100000:3.0:1789760785.725984:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760785.726190:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863184896 00000100:00100000:0.0:1789760785.726206:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863184896 00000100:00100000:0.0:1789760785.726270:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 389810975269 time 389811183857 state 0x0 ref 1 00000100:00100000:0.0:1789760785.726284:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 390011183857 time 389811183857 state 0x1 ref 1 00000100:00100000:2.0:1789760785.898697:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 390011183857 time 390011881833 state 0x0 ref 1 00000100:00100000:2.0:1789760785.898732:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277d76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863184896:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760785.898779:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6475d45/0x3e099f5ef04af0e8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.898796:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789760785.898820:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760785.898828:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6475d45/0x3e099f5ef04af0e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.898844:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6475d45/0x3e099f5ef04af0e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.915789:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6475d45/0x3e099f5ef04af0e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.915839:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6475d45/0x3e099f5ef04af0e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.915861:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6475d45/0x3e099f5ef04af0e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.915869:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243ee9200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760785.915875:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6475d45/0x3e099f5ef04af0e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.915884:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6475d45/0x3e099f5ef04af0e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.915904:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6475d45/0x3e099f5ef04af0e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760785.915912:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6475d45/0x3e099f5ef04af0e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [36700160->37748735] (req 36700160->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760785.916007:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277d76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863184896:12345-192.168.203.12@tcp:3:dd.500 Request processed in 17278us (190018us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760785.916017:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 167 00000100:00100000:2.0:1789760785.916025:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 390011183857 time 390011881833 state 0x2 ref 0 00000100:00100000:2.0:1789760785.928541:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760785.928899:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863185024 00000100:00100000:1.0:1789760785.928909:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863185024 00000100:00100000:1.0:1789760785.928979:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 390011183857 time 390011881833 state 0x0 ref 1 00000100:00100000:1.0:1789760785.928992:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 390211881833 time 390011881833 state 0x1 ref 1 00000100:00100000:1.0:1789760785.999044:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df277d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883063808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760785.999124:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760785.999238:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883063808 00000100:00100000:3.0:1789760785.999246:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883063808 00000100:00100000:3.0:1789760785.999300:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789760785.999310:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24626c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883063808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760785.999342:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241893376 pending 0 free 3754950656 avail 3752853504 00000100:00080000:2.0:1789760785.999739:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760786.002844:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24626c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883063808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3522us (3705us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760786.002861:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789760786.004988:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df277d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883063808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789760786.099142:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 390211881833 time 390212328161 state 0x0 ref 1 00000100:00100000:1.0:1789760786.099255:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863185024:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760786.099314:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af0ef lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.099330:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760786.099334:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760786.099340:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af0ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.099531:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af0ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789760786.100257:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789760786.113154:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af0ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.113174:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af0ef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.113183:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af0ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.113191:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241538000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760786.113196:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af0ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.113205:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af0ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.113246:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af0ef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.113253:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af0ef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [37748736->38797311] (req 37748736->38797311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760786.113339:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863185024:12345-192.168.203.12@tcp:3:dd.500 Request processed in 14175us (184803us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760786.113349:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 168 00000100:00100000:1.0:1789760786.113357:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 390211881833 time 390212328161 state 0x2 ref 0 00000100:00100000:3.0:1789760786.124600:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760786.125448:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863185152 00000100:00100000:2.0:1789760786.125459:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863185152 00000100:00100000:2.0:1789760786.125525:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 390211881833 time 390212328161 state 0x0 ref 1 00000100:00100000:2.0:1789760786.125537:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 390412328161 time 390212328161 state 0x1 ref 1 00000100:00100000:0.0:1789760786.300249:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 390412328161 time 390413434545 state 0x0 ref 1 00000100:00100000:0.0:1789760786.300282:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863185152:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760786.300324:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af0f6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.300342:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760786.300347:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760786.300353:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af0f6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.300367:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af0f6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.322372:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af0f6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.322392:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af0f6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.322401:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af0f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.322440:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df259bd3000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760786.322445:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af0f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.322454:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af0f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.322473:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af0f6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.322481:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af0f6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760786.322593:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863185152:12345-192.168.203.12@tcp:3:dd.500 Request processed in 22322us (197996us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760786.322603:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 169 00000100:00100000:0.0:1789760786.322611:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 390412328161 time 390413434545 state 0x2 ref 0 00000100:00100000:3.0:1789760786.339633:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760786.339749:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863185280 00000100:00100000:0.0:1789760786.339760:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863185280 00000100:00100000:0.0:1789760786.339857:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 390412328161 time 390413434545 state 0x0 ref 1 00000100:00100000:0.0:1789760786.339871:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 390613434545 time 390413434545 state 0x1 ref 1 00000100:00100000:2.0:1789760786.500406:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 390613434545 time 390613591568 state 0x0 ref 1 00000100:00100000:2.0:1789760786.500437:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277d75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863185280:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760786.500481:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f1456231/0x3e099f5ef04af0fd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.500498:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760786.500503:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760786.500509:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1456231/0x3e099f5ef04af0fd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.500522:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1456231/0x3e099f5ef04af0fd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.510437:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f1456231/0x3e099f5ef04af0fd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.510464:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1456231/0x3e099f5ef04af0fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.510474:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1456231/0x3e099f5ef04af0fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.510482:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df246207600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760786.510500:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1456231/0x3e099f5ef04af0fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.510510:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1456231/0x3e099f5ef04af0fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.510530:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1456231/0x3e099f5ef04af0fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760786.510538:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1456231/0x3e099f5ef04af0fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760786.510914:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277d75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863185280:12345-192.168.203.12@tcp:3:dd.500 Request processed in 10485us (171284us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760786.510926:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 170 00000100:00100000:2.0:1789760786.510935:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 390613434545 time 390613591568 state 0x2 ref 0 00000100:00100000:2.0:1789760786.523544:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760786.523706:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863185408 00000100:00100000:1.0:1789760786.523716:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863185408 00000100:00100000:1.0:1789760786.523771:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 390613434545 time 390613591568 state 0x0 ref 1 00000100:00100000:1.0:1789760786.523783:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 390813591568 time 390613591568 state 0x1 ref 1 00010000:00010000:1.0:1789760786.639498:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760786.700635:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 390813591568 time 390813821255 state 0x0 ref 1 00000100:00100000:1.0:1789760786.700669:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863185408:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760786.700711:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af104 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.700730:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760786.700734:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760786.700756:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af104 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.700771:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af104 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.721914:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af104 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.721934:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af104 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.721944:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af104 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.721951:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241538000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760786.721956:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af104 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.721965:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af104 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.721985:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af104 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760786.722003:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af104 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760786.722100:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863185408:12345-192.168.203.12@tcp:3:dd.500 Request processed in 21443us (198562us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760786.722110:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 171 00000100:00100000:1.0:1789760786.722118:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 390813591568 time 390813821255 state 0x2 ref 0 00000100:00100000:3.0:1789760786.733975:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760786.734379:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863185536 00000100:00100000:2.0:1789760786.734389:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863185536 00000100:00100000:2.0:1789760786.734453:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 390813591568 time 390813821255 state 0x0 ref 1 00000100:00100000:2.0:1789760786.734465:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 391013821255 time 390813821255 state 0x1 ref 1 00000100:00100000:0.0:1789760786.906074:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 391013821255 time 391019259325 state 0x0 ref 1 00000100:00100000:0.0:1789760786.906109:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863185536:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760786.906168:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af10b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.906184:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789760786.906189:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760786.906195:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af10b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.906212:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af10b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.921285:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af10b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.921306:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af10b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.921316:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af10b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.921323:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df259bd3000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760786.921328:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af10b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.921337:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af10b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.921377:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af10b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760786.921385:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af10b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760786.921470:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863185536:12345-192.168.203.12@tcp:3:dd.500 Request processed in 15374us (187500us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760786.921480:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 172 00000100:00100000:0.0:1789760786.921489:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 391013821255 time 391019259325 state 0x2 ref 0 00000100:00100000:3.0:1789760786.932181:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760786.932270:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863185664 00000100:00100000:0.0:1789760786.932280:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863185664 00000100:00100000:0.0:1789760786.932333:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 391013821255 time 391019259325 state 0x0 ref 1 00000100:00100000:0.0:1789760786.932345:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 391219259325 time 391019259325 state 0x1 ref 1 00000100:00100000:2.0:1789760787.108174:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 391219259325 time 391221357301 state 0x0 ref 1 00000100:00100000:2.0:1789760787.108216:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863185664:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760787.108261:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000324ceb6d/0x3e099f5ef04af112 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.108292:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760787.108297:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760787.108304:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000324ceb6d/0x3e099f5ef04af112 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760787.108319:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000324ceb6d/0x3e099f5ef04af112 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.124665:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000324ceb6d/0x3e099f5ef04af112 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.124687:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000324ceb6d/0x3e099f5ef04af112 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.124696:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000324ceb6d/0x3e099f5ef04af112 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.124703:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df26d1c4a00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760787.124707:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000324ceb6d/0x3e099f5ef04af112 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.124716:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000324ceb6d/0x3e099f5ef04af112 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.124735:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000324ceb6d/0x3e099f5ef04af112 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.124744:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000324ceb6d/0x3e099f5ef04af112 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [42991616->44040191] (req 42991616->44040191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760787.124885:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863185664:12345-192.168.203.12@tcp:3:dd.500 Request processed in 16687us (192709us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760787.124897:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 173 00000100:00100000:1.0:1789760787.124904:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 391219259325 time 391221357301 state 0x2 ref 0 00000100:00100000:3.0:1789760787.138588:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760787.138674:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863185792 00000100:00100000:1.0:1789760787.138685:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863185792 00000100:00100000:1.0:1789760787.138737:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 391219259325 time 391221357301 state 0x0 ref 1 00000100:00100000:1.0:1789760787.138749:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 391421357301 time 391221357301 state 0x1 ref 1 00000100:00100000:1.0:1789760787.308349:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 391421357301 time 391421534105 state 0x0 ref 1 00000100:00100000:1.0:1789760787.308383:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863185792:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760787.308429:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af119 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.308446:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760787.308450:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760787.308457:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af119 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.308472:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af119 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.326795:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af119 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.326862:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af119 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.326872:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af119 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.326879:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241538000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760787.326884:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af119 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.326893:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af119 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.326912:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af119 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.326920:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af119 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [44040192->45088767] (req 44040192->45088767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760787.327014:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863185792:12345-192.168.203.12@tcp:3:dd.500 Request processed in 18644us (188432us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760787.327025:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 174 00000100:00100000:1.0:1789760787.327033:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 391421357301 time 391421534105 state 0x2 ref 0 00000100:00100000:3.0:1789760787.337323:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760787.337622:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863185920 00000100:00100000:2.0:1789760787.337633:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863185920 00000100:00100000:2.0:1789760787.337686:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 391421357301 time 391421534105 state 0x0 ref 1 00000100:00100000:2.0:1789760787.337699:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 391621534105 time 391421534105 state 0x1 ref 1 00000100:00100000:0.0:1789760787.508497:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 391621534105 time 391621683493 state 0x0 ref 1 00000100:00100000:0.0:1789760787.508530:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277d74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863185920:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760787.508572:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af120 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.508585:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760787.508588:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760787.508593:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af120 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.508615:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af120 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.531620:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af120 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.531641:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af120 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.531651:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af120 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.531658:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df259bd3000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760787.531663:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af120 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.531671:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af120 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.531691:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af120 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760787.531699:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af120 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760787.531853:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277d74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863185920:12345-192.168.203.12@tcp:3:dd.500 Request processed in 23333us (194535us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760787.531863:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 175 00000100:00100000:0.0:1789760787.531871:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 391621534105 time 391621683493 state 0x2 ref 0 00000100:00100000:0.0:1789760787.535146:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2687de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883064192:0@lo:400:kworker.0 00000100:00100000:0.0:1789760787.535223:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760787.535279:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789760787.535287:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2687dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883064320:0@lo:400:kworker.0 00000100:00100000:0.0:1789760787.535313:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760787.535351:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883064192 00000100:00100000:0.0:1789760787.535358:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883064192 00000100:00100000:0.0:1789760787.535721:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789760787.535731:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883064192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760787.535788:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883064192:12345-0@lo:400:kworker.0 Request processed in 59us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760787.535795:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789760787.535844:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883064320 00000100:00100000:0.0:1789760787.535848:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883064320 00000100:00100000:0.0:1789760787.535880:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789760787.535887:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883064320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760787.535920:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883064320:12345-0@lo:400:kworker.0 Request processed in 35us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760787.535927:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789760787.535962:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2687dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883064320:0@lo:400:kworker.0 00000100:00100000:0.0:1789760787.535999:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2687de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883064192:0@lo:400:kworker.0 00000100:00100000:3.0:1789760787.537046:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2687ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883064064:0@lo:400:kworker.0 00000100:00100000:3.0:1789760787.537091:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760787.537126:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2687dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883064576:0@lo:400:kworker.0 00000100:00100000:3.0:1789760787.537148:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760787.537180:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789760787.537187:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2687df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699883063936:0@lo:400:kworker.0 00000100:00100000:3.0:1789760787.537228:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760787.537249:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2687ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1876699883064448:0@lo:400:kworker.0 00000100:00100000:3.0:1789760787.537269:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760787.537298:0:8482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883064576 00000100:00100000:3.0:1789760787.537303:0:8482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883064576 00000100:00100000:3.0:1789760787.537340:0:8482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789760787.537355:0:8482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277d74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883064576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760787.537435:0:8482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277d74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883064576:12345-0@lo:400:kworker.0 Request processed in 81us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760787.537452:0:8482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789760787.537478:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883063936 00000100:00100000:3.0:1789760787.537482:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883063936 00000100:00100000:3.0:1789760787.537510:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1789760787.537516:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883064064 00000100:00100000:3.0:1789760787.537519:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3311:x1876699883063936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760787.537529:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883064064 00000100:00100000:3.0:1789760787.537556:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e2780560-8e82-4256-94b0-2e524f3bed06+19:3311:x1876699883063936:12345-0@lo:400:kworker.0 Request processed in 39us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760787.537564:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883064448 00000100:00100000:3.0:1789760787.537564:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1789760787.537569:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883064448 00000100:00100000:3.0:1789760787.537605:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789760787.538086:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789760787.538097:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277d77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876699883064448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760787.538140:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277d77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876699883064448:12345-0@lo:400:kworker.0 Request processed in 47us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760787.538147:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789760787.538203:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2687df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699883063936:0@lo:400:kworker.0 00000100:00100000:1.0:1789760787.538217:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2687ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1876699883064448:0@lo:400:kworker.0 00000100:00100000:1.0:1789760787.538227:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2687dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883064576:0@lo:400:kworker.0 00000100:00080000:2.0:1789760787.538358:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789760787.538363:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789760787.538366:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760787.539619:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277d76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883064064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789760787.539741:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277d76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883064064:12345-0@lo:400:kworker.0 Request processed in 2128us (2648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760787.539750:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789760787.539886:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2687ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883064064:0@lo:400:kworker.0 00000100:00100000:2.0:1789760787.543911:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760787.544036:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863186048 00000100:00100000:0.0:1789760787.544128:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863186048 00000100:00100000:0.0:1789760787.544179:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 391621534105 time 391621683493 state 0x0 ref 1 00000100:00100000:0.0:1789760787.544192:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 391821683493 time 391621683493 state 0x1 ref 1 00010000:00010000:0.0:1789760787.663024:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760787.708662:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 391821683493 time 391821847297 state 0x0 ref 1 00000100:00100000:1.0:1789760787.708698:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863186048:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760787.708746:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af127 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.708763:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760787.708768:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760787.708775:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af127 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.708788:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af127 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.718577:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af127 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.718593:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af127 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.718599:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af127 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.718604:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241538000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760787.718608:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af127 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.718614:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af127 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.718637:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af127 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.718642:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af127 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [46137344->47185919] (req 46137344->47185919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760787.718718:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863186048:12345-192.168.203.12@tcp:3:dd.500 Request processed in 10034us (174813us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760787.718728:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 176 00000100:00100000:1.0:1789760787.718745:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 391821683493 time 391821847297 state 0x2 ref 0 00000100:00100000:3.0:1789760787.723419:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760787.723659:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863186176 00000100:00100000:1.0:1789760787.723669:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863186176 00000100:00100000:1.0:1789760787.723747:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 391821683493 time 391821847297 state 0x0 ref 1 00000100:00100000:1.0:1789760787.723761:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 392021847297 time 391821847297 state 0x1 ref 1 00000100:00100000:1.0:1789760787.909532:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 392021847297 time 392022717631 state 0x0 ref 1 00000100:00100000:1.0:1789760787.909578:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863186176:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760787.909627:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af12e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.909645:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789760787.909650:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760787.909657:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af12e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.909673:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af12e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.918502:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af12e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.918523:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af12e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.918533:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af12e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.918554:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241538000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760787.918559:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af12e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.918569:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af12e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.918589:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af12e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760787.918598:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af12e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [47185920->48234495] (req 47185920->48234495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760787.918679:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863186176:12345-192.168.203.12@tcp:3:dd.500 Request processed in 9124us (195264us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760787.918689:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 177 00000100:00100000:1.0:1789760787.918697:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 392021847297 time 392022717631 state 0x2 ref 0 00000100:00100000:3.0:1789760787.924726:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760787.924955:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863186304 00000100:00100000:2.0:1789760787.924965:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863186304 00000100:00100000:2.0:1789760787.925120:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 392021847297 time 392022717631 state 0x0 ref 1 00000100:00100000:2.0:1789760787.925135:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 392222717631 time 392022717631 state 0x1 ref 1 00000100:00100000:2.0:1789760788.048552:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2687de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883064704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760788.048625:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760788.051856:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883064704 00000100:00100000:0.0:1789760788.051872:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883064704 00000100:00100000:0.0:1789760788.051947:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789760788.051958:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883064704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789760788.052011:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760788.052117:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883064704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (3491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760788.052124:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789760788.052183:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2687de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883064704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789760788.114958:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 392222717631 time 392228141386 state 0x0 ref 1 00000100:00100000:0.0:1789760788.115082:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863186304:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760788.115128:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af135 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.115146:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760788.115150:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760788.115157:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af135 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.115192:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af135 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789760788.115290:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789760788.141532:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af135 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.141552:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af135 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.141561:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af135 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.141568:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df259bd3000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760788.141573:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af135 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.141582:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af135 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.141602:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af135 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.141609:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011b4c75b/0x3e099f5ef04af135 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [48234496->49283071] (req 48234496->49283071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760788.141711:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863186304:12345-192.168.203.12@tcp:3:dd.500 Request processed in 26730us (216989us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760788.141721:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 178 00000100:00100000:0.0:1789760788.141728:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 392222717631 time 392228141386 state 0x2 ref 0 00000100:00100000:3.0:1789760788.156780:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760788.160117:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863186432 00000100:00100000:0.0:1789760788.160130:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863186432 00000100:00100000:0.0:1789760788.160188:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 392222717631 time 392228141386 state 0x0 ref 1 00000100:00100000:0.0:1789760788.160211:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 392428141386 time 392228141386 state 0x1 ref 1 00000100:00100000:1.0:1789760788.315112:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 392428141386 time 392428297871 state 0x0 ref 1 00000100:00100000:1.0:1789760788.315146:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277d75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863186432:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760788.315187:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af13c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.315234:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.315239:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.315246:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af13c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.315271:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af13c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.339160:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af13c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.339188:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af13c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.339201:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af13c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.339208:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241538000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760788.339213:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af13c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.339222:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af13c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.339241:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af13c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.339266:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af13c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.339631:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277d75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863186432:12345-192.168.203.12@tcp:3:dd.500 Request processed in 24212us (182572us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760788.339643:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 179 00000100:00100000:1.0:1789760788.339652:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 392428141386 time 392428297871 state 0x2 ref 0 00000100:00100000:3.0:1789760788.350719:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760788.350832:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863186560 00000100:00100000:1.0:1789760788.350842:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863186560 00000100:00100000:1.0:1789760788.350900:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 392428141386 time 392428297871 state 0x0 ref 1 00000100:00100000:1.0:1789760788.350912:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 392628297871 time 392428297871 state 0x1 ref 1 00000100:00100000:1.0:1789760788.515174:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 392628297871 time 392628359422 state 0x0 ref 1 00000100:00100000:1.0:1789760788.515207:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277d76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863186560:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760788.515246:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af143 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.515263:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.515267:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.515273:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af143 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.515287:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af143 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.532046:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af143 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.532065:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af143 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.532074:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af143 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.532082:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241538000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760788.532087:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af143 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.532096:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af143 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.532114:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af143 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.532122:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af143 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [50331648->51380223] (req 50331648->51380223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.532213:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277d76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863186560:12345-192.168.203.12@tcp:3:dd.500 Request processed in 17016us (181497us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760788.532223:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 180 00000100:00100000:1.0:1789760788.532243:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 392628297871 time 392628359422 state 0x2 ref 0 00000100:00100000:3.0:1789760788.536583:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760788.536754:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863186688 00000100:00100000:2.0:1789760788.536778:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863186688 00000100:00100000:2.0:1789760788.536874:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 392628297871 time 392628359422 state 0x0 ref 1 00000100:00100000:2.0:1789760788.536889:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 392828359422 time 392628359422 state 0x1 ref 1 00010000:00010000:2.0:1789760788.688768:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760788.715504:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 392828359422 time 392828689539 state 0x0 ref 1 00000100:00100000:0.0:1789760788.715546:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df277d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863186688:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760788.715588:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4dcfef/0x3e099f5ef04af14a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.715606:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760788.715610:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760788.715616:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4dcfef/0x3e099f5ef04af14a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.715629:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4dcfef/0x3e099f5ef04af14a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.727909:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4dcfef/0x3e099f5ef04af14a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.727943:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4dcfef/0x3e099f5ef04af14a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.727952:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4dcfef/0x3e099f5ef04af14a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.727960:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df259bd3600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760788.727964:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4dcfef/0x3e099f5ef04af14a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.727989:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4dcfef/0x3e099f5ef04af14a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.728009:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4dcfef/0x3e099f5ef04af14a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.728018:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4dcfef/0x3e099f5ef04af14a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760788.728116:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df277d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863186688:12345-192.168.203.12@tcp:3:dd.500 Request processed in 12590us (191538us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760788.728126:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 181 00000100:00100000:0.0:1789760788.728135:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 392828359422 time 392828689539 state 0x2 ref 0 00000100:00100000:3.0:1789760788.737043:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760788.737224:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863186816 00000100:00100000:0.0:1789760788.737248:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863186816 00000100:00100000:0.0:1789760788.737301:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 392828359422 time 392828689539 state 0x0 ref 1 00000100:00100000:0.0:1789760788.737314:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 393028689539 time 392828689539 state 0x1 ref 1 00000100:00100000:1.0:1789760788.915794:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 393028689539 time 393028978912 state 0x0 ref 1 00000100:00100000:1.0:1789760788.915862:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863186816:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760788.915905:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af151 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.915922:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789760788.915927:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760788.915933:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af151 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.915950:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af151 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.924550:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af151 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.924570:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af151 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.924579:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af151 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.924587:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241538000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760788.924592:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af151 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.924617:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af151 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.924638:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af151 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.924645:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af151 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [52428800->53477375] (req 52428800->53477375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.924733:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863186816:12345-192.168.203.12@tcp:3:dd.500 Request processed in 8883us (187695us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760788.924744:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 182 00000100:00100000:1.0:1789760788.924752:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 393028689539 time 393028978912 state 0x2 ref 0 00000100:00100000:3.0:1789760788.937225:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760788.937302:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863186944 00000100:00100000:1.0:1789760788.937315:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863186944 00000100:00100000:1.0:1789760788.937366:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 393028689539 time 393028978912 state 0x0 ref 1 00000100:00100000:1.0:1789760788.937380:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 393228978912 time 393028978912 state 0x1 ref 1 00000100:00100000:1.0:1789760789.117418:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 393228978912 time 393230604371 state 0x0 ref 1 00000100:00100000:1.0:1789760789.117452:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863186944:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760789.117493:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af158 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.117529:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760789.117533:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760789.117540:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af158 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.117554:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af158 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.130440:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af158 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.130458:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af158 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.130467:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af158 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.130474:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241538000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760789.130479:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af158 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.130489:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af158 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.130508:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af158 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.130535:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af158 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760789.130612:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863186944:12345-192.168.203.12@tcp:3:dd.500 Request processed in 13171us (193393us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760789.130623:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 183 00000100:00100000:1.0:1789760789.130631:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 393228978912 time 393230604371 state 0x2 ref 0 00000100:00100000:3.0:1789760789.137573:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760789.137706:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863187072 00000100:00100000:2.0:1789760789.137717:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863187072 00000100:00100000:2.0:1789760789.137774:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 393228978912 time 393230604371 state 0x0 ref 1 00000100:00100000:2.0:1789760789.137787:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 393430604371 time 393230604371 state 0x1 ref 1 00000100:00100000:0.0:1789760789.321015:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 393430604371 time 393434201380 state 0x0 ref 1 00000100:00100000:0.0:1789760789.321049:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d31d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863187072:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760789.321090:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4dcfef/0x3e099f5ef04af15f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.321107:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760789.321111:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760789.321118:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4dcfef/0x3e099f5ef04af15f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.321132:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4dcfef/0x3e099f5ef04af15f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.346415:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4dcfef/0x3e099f5ef04af15f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.346432:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4dcfef/0x3e099f5ef04af15f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.346443:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4dcfef/0x3e099f5ef04af15f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.346470:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df259bd3600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760789.346475:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4dcfef/0x3e099f5ef04af15f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.346484:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4dcfef/0x3e099f5ef04af15f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.346503:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4dcfef/0x3e099f5ef04af15f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.346510:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4dcfef/0x3e099f5ef04af15f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [54525952->55574527] (req 54525952->55574527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760789.346706:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d31d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863187072:12345-192.168.203.12@tcp:3:dd.500 Request processed in 25668us (209136us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760789.346717:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 184 00000100:00100000:0.0:1789760789.346725:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 393430604371 time 393434201380 state 0x2 ref 0 00000100:00100000:3.0:1789760789.354923:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760789.356039:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863187200 00000100:00100000:0.0:1789760789.356051:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863187200 00000100:00100000:0.0:1789760789.356109:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 393430604371 time 393434201380 state 0x0 ref 1 00000100:00100000:0.0:1789760789.356124:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 393634201380 time 393434201380 state 0x1 ref 1 00000100:00100000:1.0:1789760789.521501:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 393634201380 time 393634634019 state 0x0 ref 1 00000100:00100000:1.0:1789760789.521537:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d31ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863187200:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760789.521667:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af166 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.521683:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760789.521687:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760789.521693:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af166 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.521707:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af166 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.541111:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af166 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.541150:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af166 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.541160:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af166 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.541168:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241538000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760789.541174:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af166 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.541184:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af166 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.541211:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af166 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.541218:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af166 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [55574528->56623103] (req 55574528->56623103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760789.541298:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d31ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863187200:12345-192.168.203.12@tcp:3:dd.500 Request processed in 19775us (186503us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760789.541308:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 185 00000100:00100000:1.0:1789760789.541316:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 393634201380 time 393634634019 state 0x2 ref 0 00000100:00100000:2.0:1789760789.547526:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760789.547698:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863187328 00000100:00100000:1.0:1789760789.547725:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863187328 00000100:00100000:1.0:1789760789.547778:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 393634201380 time 393634634019 state 0x0 ref 1 00000100:00100000:1.0:1789760789.547792:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 393834634019 time 393634634019 state 0x1 ref 1 00010000:00010000:1.0:1789760789.711106:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760789.721670:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 393834634019 time 393834855288 state 0x0 ref 1 00000100:00100000:1.0:1789760789.721715:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863187328:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760789.721755:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af16d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.721772:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760789.721777:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760789.721783:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af16d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.721797:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af16d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.741932:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af16d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.741952:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af16d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.741961:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af16d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.741994:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241538000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760789.742000:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af16d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.742009:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af16d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.742028:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af16d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760789.742035:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af16d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760789.742118:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863187328:12345-192.168.203.12@tcp:3:dd.500 Request processed in 20416us (194596us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760789.742129:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 186 00000100:00100000:1.0:1789760789.742138:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 393834634019 time 393834855288 state 0x2 ref 0 00000100:00100000:2.0:1789760789.754916:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760789.757705:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863187456 00000100:00100000:0.0:1789760789.757721:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863187456 00000100:00100000:0.0:1789760789.757782:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 393834634019 time 393834855288 state 0x0 ref 1 00000100:00100000:0.0:1789760789.757843:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 394034855288 time 393834855288 state 0x1 ref 1 00000100:00100000:0.0:1789760789.921850:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 394034855288 time 394034985936 state 0x0 ref 1 00000100:00100000:0.0:1789760789.921888:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863187456:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760789.921934:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4dcfef/0x3e099f5ef04af174 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.921952:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789760789.921957:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760789.921975:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4dcfef/0x3e099f5ef04af174 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.921993:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4dcfef/0x3e099f5ef04af174 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.933876:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4dcfef/0x3e099f5ef04af174 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.933896:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4dcfef/0x3e099f5ef04af174 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.933906:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4dcfef/0x3e099f5ef04af174 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.933913:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df259bd3600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760789.933917:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4dcfef/0x3e099f5ef04af174 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.933939:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4dcfef/0x3e099f5ef04af174 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.933958:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4dcfef/0x3e099f5ef04af174 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760789.933978:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4dcfef/0x3e099f5ef04af174 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760789.934065:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863187456:12345-192.168.203.12@tcp:3:dd.500 Request processed in 12187us (179148us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760789.934076:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 187 00000100:00100000:0.0:1789760789.934083:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 394034855288 time 394034985936 state 0x2 ref 0 00000100:00100000:2.0:1789760789.940213:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760789.940305:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863187584 00000100:00100000:0.0:1789760789.940316:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863187584 00000100:00100000:0.0:1789760789.940368:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 394034855288 time 394034985936 state 0x0 ref 1 00000100:00100000:0.0:1789760789.940380:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 394234985936 time 394034985936 state 0x1 ref 1 00000100:00100000:1.0:1789760790.122139:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 394234985936 time 394235325225 state 0x0 ref 1 00000100:00100000:1.0:1789760790.122191:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d660a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863187584:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760790.122235:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af17b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.122251:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760790.122267:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760790.122274:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af17b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.122288:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af17b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789760790.123533:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789760790.132365:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760790.132416:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760790.132440:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760790.132511:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863187840 00000100:00100000:0.0:1789760790.132521:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863187840 00000100:00100000:0.0:1789760790.132589:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863187968 00000100:00100000:0.0:1789760790.132592:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863187968 00000100:00100000:0.0:1789760790.132619:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 203 00000100:00100000:0.0:1789760790.132628:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+9:2349:x1876699863187840:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760790.132678:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863187712 00000100:00100000:3.0:1789760790.132683:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863187712 00000100:00100000:0.0:1789760790.132705:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1da0113a-370d-4d79-883c-54efc174697f+9:2349:x1876699863187840:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 77us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760790.132724:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 293 00000100:00100000:3.0:1789760790.132733:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2349:x1876699863187712:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760790.132762:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2349:x1876699863187712:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 30us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760790.132768:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 293 00000100:00100000:0.0:1789760790.132798:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 203 00000100:00100000:0.0:1789760790.132859:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 204 00000100:00100000:0.0:1789760790.132866:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2349:x1876699863187968:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1789760790.132895:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2349:x1876699863187968:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760790.132901:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 204 00010000:00010000:1.0:1789760790.133069:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af17b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.133088:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af17b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.133097:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af17b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.133105:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241538000 already unused, calling callback (ffffffffc15cb350) 00000100:00080000:2.0:1789760790.133106:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789760790.133111:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af17b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.133122:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af17b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.133143:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af17b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.133151:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af17b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760790.133351:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d660a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863187584:12345-192.168.203.12@tcp:3:dd.500 Request processed in 11193us (193146us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760790.133361:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 188 00000100:00100000:1.0:1789760790.133368:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 394234985936 time 394235325225 state 0x2 ref 0 00000100:00100000:0.0:1789760790.150629:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760790.150710:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863188096 00000100:00100000:1.0:1789760790.150722:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863188096 00000100:00100000:1.0:1789760790.150786:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 394234985936 time 394235325225 state 0x0 ref 1 00000100:00100000:1.0:1789760790.150826:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 394435325225 time 394235325225 state 0x1 ref 1 00000100:00100000:1.0:1789760790.322372:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 394435325225 time 394435556888 state 0x0 ref 1 00000100:00100000:1.0:1789760790.322408:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863188096:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760790.322449:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af182 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.322466:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760790.322469:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760790.322476:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af182 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.322489:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af182 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.370470:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af182 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.370491:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af182 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.370502:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af182 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.370511:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241538000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760790.370607:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af182 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.370618:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af182 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.370637:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af182 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.370646:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001948bae7/0x3e099f5ef04af182 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760790.370729:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863188096:12345-192.168.203.12@tcp:3:dd.500 Request processed in 48334us (220104us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760790.370739:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 189 00000100:00100000:2.0:1789760790.370747:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 394435325225 time 394435556888 state 0x2 ref 0 00000100:00100000:1.0:1789760790.379594:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760790.379716:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863188224 00000100:00100000:0.0:1789760790.379727:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863188224 00000100:00100000:0.0:1789760790.379781:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 394435325225 time 394435556888 state 0x0 ref 1 00000100:00100000:0.0:1789760790.379836:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 394635556888 time 394435556888 state 0x1 ref 1 00000100:00100000:0.0:1789760790.522997:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 394635556888 time 394636183222 state 0x0 ref 1 00000100:00100000:0.0:1789760790.523036:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24626dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863188224:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760790.523078:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d2488a70/0x3e099f5ef04af189 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.523094:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760790.523099:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760790.523105:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2488a70/0x3e099f5ef04af189 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.523119:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2488a70/0x3e099f5ef04af189 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.548050:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d2488a70/0x3e099f5ef04af189 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.548070:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2488a70/0x3e099f5ef04af189 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.548079:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2488a70/0x3e099f5ef04af189 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.548087:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df259bd2000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760790.548092:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2488a70/0x3e099f5ef04af189 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.548101:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2488a70/0x3e099f5ef04af189 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.548120:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2488a70/0x3e099f5ef04af189 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.548127:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2488a70/0x3e099f5ef04af189 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [60817408->61865983] (req 60817408->61865983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760790.548213:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24626dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863188224:12345-192.168.203.12@tcp:3:dd.500 Request processed in 25195us (168625us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760790.548224:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 190 00000100:00100000:0.0:1789760790.548246:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 394635556888 time 394636183222 state 0x2 ref 0 00000100:00100000:3.0:1789760790.555050:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760790.556253:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863188352 00000100:00100000:0.0:1789760790.556269:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863188352 00000100:00100000:0.0:1789760790.556325:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 394635556888 time 394636183222 state 0x0 ref 1 00000100:00100000:0.0:1789760790.556341:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 394836183222 time 394636183222 state 0x1 ref 1 00000100:00100000:1.0:1789760790.723872:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 394836183222 time 394837058100 state 0x0 ref 1 00000100:00100000:1.0:1789760790.723906:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d31c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863188352:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760790.723968:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007b0e6d9f/0x3e099f5ef04af190 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.723986:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760790.723991:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760790.723998:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b0e6d9f/0x3e099f5ef04af190 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.724013:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b0e6d9f/0x3e099f5ef04af190 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760790.734971:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760790.738858:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007b0e6d9f/0x3e099f5ef04af190 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.738878:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b0e6d9f/0x3e099f5ef04af190 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.738888:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b0e6d9f/0x3e099f5ef04af190 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.738896:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241539600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760790.738901:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b0e6d9f/0x3e099f5ef04af190 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.738929:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b0e6d9f/0x3e099f5ef04af190 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.739085:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b0e6d9f/0x3e099f5ef04af190 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760790.739096:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b0e6d9f/0x3e099f5ef04af190 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [61865984->62914559] (req 61865984->62914559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760790.739185:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d31c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863188352:12345-192.168.203.12@tcp:3:dd.500 Request processed in 15291us (184143us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760790.739196:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 191 00000100:00100000:1.0:1789760790.739204:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 394836183222 time 394837058100 state 0x2 ref 0 00000100:00100000:3.0:1789760790.747829:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760790.747956:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863188480 00000100:00100000:1.0:1789760790.747974:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863188480 00000100:00100000:1.0:1789760790.748170:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 394836183222 time 394837058100 state 0x0 ref 1 00000100:00100000:1.0:1789760790.748184:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 395037058100 time 394837058100 state 0x1 ref 1 00000100:00100000:2.0:1789760790.925333:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 395037058100 time 395038517621 state 0x0 ref 1 00000100:00100000:2.0:1789760790.925368:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d31f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863188480:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760790.925409:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af197 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.925426:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789760790.925432:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760790.925438:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af197 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.925472:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af197 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.946383:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af197 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.946403:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af197 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.946413:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af197 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.946420:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760790.946425:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af197 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.946433:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af197 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.946451:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af197 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760790.946459:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af197 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760790.946590:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d31f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863188480:12345-192.168.203.12@tcp:3:dd.500 Request processed in 21235us (198797us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760790.946601:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 192 00000100:00100000:2.0:1789760790.946609:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 395037058100 time 395038517621 state 0x2 ref 0 00000100:00100000:3.0:1789760790.956408:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760790.958264:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863188608 00000100:00100000:0.0:1789760790.958278:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863188608 00000100:00100000:0.0:1789760790.958344:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 395037058100 time 395038517621 state 0x0 ref 1 00000100:00100000:0.0:1789760790.958357:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 395238517621 time 395038517621 state 0x1 ref 1 00000100:00100000:2.0:1789760791.120211:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d31e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883064832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760791.120276:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760791.120380:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883064832 00000100:00100000:3.0:1789760791.120389:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883064832 00000100:00100000:3.0:1789760791.120444:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789760791.120453:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883064832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789760791.120485:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241893376 pending 0 free 3754950656 avail 3752853504 00000100:00080000:0.0:1789760791.121521:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760791.122541:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883064832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2081us (2256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760791.122553:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789760791.125857:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 395238517621 time 395239042948 state 0x0 ref 1 00000100:00100000:0.0:1789760791.125887:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d31fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863188608:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760791.125932:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04af19e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.125949:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760791.125964:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760791.125971:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04af19e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760791.125985:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04af19e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.128167:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d31e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883064832:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789760791.158999:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04af19e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.159019:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04af19e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.159033:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04af19e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.159051:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df243a67000 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760791.159056:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04af19e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.159065:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04af19e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.159086:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04af19e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.159108:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d41e7916/0x3e099f5ef04af19e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [63963136->65011711] (req 63963136->65011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.159182:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d31fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863188608:12345-192.168.203.12@tcp:3:dd.500 Request processed in 33303us (202792us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760791.159193:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 193 00000100:00100000:2.0:1789760791.159201:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 395238517621 time 395239042948 state 0x2 ref 0 00000100:00100000:3.0:1789760791.169890:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760791.171649:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863188736 00000100:00100000:0.0:1789760791.171664:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863188736 00000100:00100000:0.0:1789760791.171721:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 395238517621 time 395239042948 state 0x0 ref 1 00000100:00100000:0.0:1789760791.171737:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 395439042948 time 395239042948 state 0x1 ref 1 00000100:00100000:1.0:1789760791.326041:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 395439042948 time 395439225506 state 0x0 ref 1 00000100:00100000:1.0:1789760791.326081:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d31dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863188736:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760791.326129:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af1a5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.326165:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760791.326169:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760791.326175:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af1a5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.326188:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af1a5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.353127:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af1a5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.353147:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af1a5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.353158:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af1a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.353166:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240030e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760791.353171:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af1a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.353181:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af1a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.353200:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af1a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.353226:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af1a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [65011712->66060287] (req 65011712->66060287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760791.353311:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d31dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863188736:12345-192.168.203.12@tcp:3:dd.500 Request processed in 27246us (183617us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789760791.353322:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 194 00000100:00100000:1.0:1789760791.353330:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 395439042948 time 395439225506 state 0x2 ref 0 00000100:00100000:0.0:1789760791.364231:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760791.364322:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863188864 00000100:00100000:1.0:1789760791.364332:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863188864 00000100:00100000:1.0:1789760791.364395:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 395439042948 time 395439225506 state 0x0 ref 1 00000100:00100000:1.0:1789760791.364408:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 395639225506 time 395439225506 state 0x1 ref 1 00000100:00100000:2.0:1789760791.526425:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 395639225506 time 395639610769 state 0x0 ref 1 00000100:00100000:2.0:1789760791.526458:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863188864:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760791.526498:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1ac lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.526630:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760791.526634:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760791.526640:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.526655:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.542594:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.542636:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1ac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.542645:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.542651:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760791.542656:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.542665:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.542684:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.542693:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.542836:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863188864:12345-192.168.203.12@tcp:3:dd.500 Request processed in 16356us (178578us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760791.542849:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 195 00000100:00100000:2.0:1789760791.542856:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 395639225506 time 395639610769 state 0x2 ref 0 00000100:00100000:0.0:1789760791.553785:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760791.553918:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863188992 00000100:00100000:2.0:1789760791.553942:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863188992 00000100:00100000:2.0:1789760791.554006:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 395639225506 time 395639610769 state 0x0 ref 1 00000100:00100000:2.0:1789760791.554030:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 395839610769 time 395639610769 state 0x1 ref 1 00000100:00100000:2.0:1789760791.726625:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 395839610769 time 395839810917 state 0x0 ref 1 00000100:00100000:2.0:1789760791.726663:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863188992:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760791.726705:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1b3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.727267:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760791.727273:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760791.727281:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1b3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.727298:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1b3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.759196:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760791.784431:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1b3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.784450:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1b3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.784459:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.784484:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760791.784489:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.784497:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.784527:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.784535:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.784629:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863188992:12345-192.168.203.12@tcp:3:dd.500 Request processed in 57981us (230848us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760791.784639:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 196 00000100:00100000:2.0:1789760791.784648:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 395839610769 time 395839810917 state 0x2 ref 0 00000100:00100000:3.0:1789760791.802160:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760791.802278:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863189120 00000100:00100000:0.0:1789760791.802289:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863189120 00000100:00100000:0.0:1789760791.802344:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 395839610769 time 395839810917 state 0x0 ref 1 00000100:00100000:0.0:1789760791.802357:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 396039810917 time 395839810917 state 0x1 ref 1 00000100:00100000:1.0:1789760791.926913:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 396039810917 time 396040099312 state 0x0 ref 1 00000100:00100000:1.0:1789760791.926947:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d31d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863189120:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:1.0:1789760791.927001:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af1ba lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.927019:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789760791.927024:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789760791.927030:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af1ba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760791.927046:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af1ba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.946254:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af1ba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.946273:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af1ba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.946283:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af1ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.946305:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240030e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760791.946311:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af1ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.946320:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af1ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.946339:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af1ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760791.946346:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af1ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760791.946428:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d31d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863189120:12345-192.168.203.12@tcp:3:dd.500 Request processed in 19493us (144274us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760791.946438:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 197 00000100:00100000:2.0:1789760791.946446:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 396039810917 time 396040099312 state 0x2 ref 0 00000100:00100000:3.0:1789760791.951915:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760791.952021:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863189248 00000100:00100000:1.0:1789760791.952033:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863189248 00000100:00100000:1.0:1789760791.952097:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 396039810917 time 396040099312 state 0x0 ref 1 00000100:00100000:1.0:1789760791.952110:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 396240099312 time 396040099312 state 0x1 ref 1 00000100:00100000:2.0:1789760792.130758:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 396240099312 time 396243944398 state 0x0 ref 1 00000100:00100000:2.0:1789760792.130870:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d31d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863189248:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760792.130921:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1c1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.130937:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760792.130965:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760792.130971:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1c1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.130985:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1c1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789760792.136708:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789760792.154358:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1c1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.154381:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1c1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.154391:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.154399:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760792.154404:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.154412:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.154430:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1c1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.154437:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1c1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.154532:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d31d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863189248:12345-192.168.203.12@tcp:3:dd.500 Request processed in 23753us (202624us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760792.154543:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 198 00000100:00100000:2.0:1789760792.154550:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 396240099312 time 396243944398 state 0x2 ref 0 00000100:00100000:0.0:1789760792.159242:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760792.159491:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863189376 00000100:00100000:1.0:1789760792.159501:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863189376 00000100:00100000:1.0:1789760792.159551:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 396240099312 time 396243944398 state 0x0 ref 1 00000100:00100000:1.0:1789760792.159563:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 396443944398 time 396243944398 state 0x1 ref 1 00000100:00100000:2.0:1789760792.331133:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 396443944398 time 396444318570 state 0x0 ref 1 00000100:00100000:2.0:1789760792.331166:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863189376:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760792.331203:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1c8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.331218:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760792.331222:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760792.331228:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1c8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.331242:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1c8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.354148:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1c8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.354166:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1c8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.354193:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.354200:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760792.354205:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.354214:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.354232:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1c8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.354240:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1c8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [70254592->71303167] (req 70254592->71303167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.354323:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863189376:12345-192.168.203.12@tcp:3:dd.500 Request processed in 23170us (195086us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760792.354332:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 199 00000100:00100000:2.0:1789760792.354340:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 396443944398 time 396444318570 state 0x2 ref 0 00000100:00100000:1.0:1789760792.376188:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760792.376275:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863189504 00000100:00100000:0.0:1789760792.376285:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863189504 00000100:00100000:0.0:1789760792.376337:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 396443944398 time 396444318570 state 0x0 ref 1 00000100:00100000:0.0:1789760792.376350:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 396644318570 time 396444318570 state 0x1 ref 1 00000100:00100000:2.0:1789760792.531630:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 396644318570 time 396644815298 state 0x0 ref 1 00000100:00100000:2.0:1789760792.531665:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24626e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863189504:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760792.531707:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1cf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.531748:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760792.531753:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760792.531760:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1cf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.531775:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1cf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.545629:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1cf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.545648:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1cf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.545658:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.545665:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760792.545670:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.545678:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.545697:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.545724:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [71303168->72351743] (req 71303168->72351743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.545860:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24626e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863189504:12345-192.168.203.12@tcp:3:dd.500 Request processed in 14207us (169675us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760792.545870:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 200 00000100:00100000:2.0:1789760792.545878:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 396644318570 time 396644815298 state 0x2 ref 0 00000100:00100000:1.0:1789760792.560277:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760792.560476:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863189632 00000100:00100000:3.0:1789760792.560487:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863189632 00000100:00100000:3.0:1789760792.560544:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 396644318570 time 396644815298 state 0x0 ref 1 00000100:00100000:3.0:1789760792.560558:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 396844815298 time 396644815298 state 0x1 ref 1 00000100:00100000:1.0:1789760792.655301:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883065088:0@lo:400:kworker.0 00000100:00100000:1.0:1789760792.655376:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760792.655435:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883065600:0@lo:400:kworker.0 00000100:00100000:1.0:1789760792.655461:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760792.655491:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789760792.655496:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df24626fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699883064960:0@lo:400:kworker.0 00000100:00100000:1.0:1789760792.655524:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760792.655544:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1876699883065472:0@lo:400:kworker.0 00000100:00100000:1.0:1789760792.655566:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760792.655597:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883065088 00000100:00100000:1.0:1789760792.655604:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883065088 00000100:00100000:1.0:1789760792.655649:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883065472 00000100:00100000:1.0:1789760792.655652:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883065472 00000100:00100000:1.0:1789760792.655692:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789760792.655702:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883065088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760792.655756:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883065088:12345-0@lo:400:kworker.0 Request processed in 55us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760792.655763:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789760792.655780:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789760792.655786:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876699883065472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760792.655838:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876699883065472:12345-0@lo:400:kworker.0 Request processed in 51us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760792.655844:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789760792.655864:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883065600 00000100:00100000:1.0:1789760792.655868:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883065600 00000100:00100000:1.0:1789760792.655897:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789760792.655903:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883065600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760792.656026:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883065600:12345-0@lo:400:kworker.0 Request processed in 122us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760792.656032:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789760792.656051:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883064960 00000100:00100000:1.0:1789760792.656054:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883064960 00000100:00100000:1.0:1789760792.656080:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1789760792.656086:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+19:3311:x1876699883064960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760792.656118:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e2780560-8e82-4256-94b0-2e524f3bed06+19:3311:x1876699883064960:12345-0@lo:400:kworker.0 Request processed in 32us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760792.656124:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1789760792.656174:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df24626fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e2780560-8e82-4256-94b0-2e524f3bed06:3311:1876699883064960:0@lo:400:kworker.0 00000100:00100000:1.0:1789760792.656189:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1876699883065472:0@lo:400:kworker.0 00000100:00100000:1.0:1789760792.656211:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883065088:0@lo:400:kworker.0 00000100:00100000:1.0:1789760792.656220:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883065600:0@lo:400:kworker.0 00000100:00100000:1.0:1789760792.656268:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883065216:0@lo:400:kworker.0 00000100:00100000:1.0:1789760792.656294:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760792.656314:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789760792.656321:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df27d0a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883065344:0@lo:400:kworker.0 00000100:00100000:1.0:1789760792.656342:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760792.656366:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883065216 00000100:00100000:1.0:1789760792.656370:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883065216 00000100:00100000:1.0:1789760792.656397:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789760792.656404:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883065216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760792.656437:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883065216:12345-0@lo:400:kworker.0 Request processed in 33us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760792.656443:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789760792.656468:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883065216:0@lo:400:kworker.0 00000100:00080000:1.0:1789760792.656493:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789760792.656497:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760792.656510:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883065344 00000100:00100000:1.0:1789760792.656514:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883065344 00000100:00100000:1.0:1789760792.656538:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789760792.656544:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883065344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789760792.656582:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883065344:12345-0@lo:400:kworker.0 Request processed in 38us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760792.656589:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789760792.656613:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df27d0a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883065344:0@lo:400:kworker.0 00000100:00100000:2.0:1789760792.731797:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 396844815298 time 396844981869 state 0x0 ref 1 00000100:00100000:2.0:1789760792.731862:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24626f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863189632:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760792.731994:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1d6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.732012:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760792.732017:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760792.732024:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1d6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.732039:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1d6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.756693:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1d6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.756738:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.756763:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.756772:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760792.756777:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.756786:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.756832:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.756841:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [72351744->73400319] (req 72351744->73400319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.756953:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24626f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863189632:12345-192.168.203.12@tcp:3:dd.500 Request processed in 25098us (196676us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760792.756965:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 201 00000100:00100000:2.0:1789760792.756973:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 396844815298 time 396844981869 state 0x2 ref 0 00000100:00100000:0.0:1789760792.766286:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760792.766449:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863189760 00000100:00100000:1.0:1789760792.766459:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863189760 00000100:00100000:1.0:1789760792.766516:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 396844815298 time 396844981869 state 0x0 ref 1 00000100:00100000:1.0:1789760792.766529:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 397044981869 time 396844981869 state 0x1 ref 1 00010000:00010000:1.0:1789760792.783088:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760792.932257:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 397044981869 time 397045441870 state 0x0 ref 1 00000100:00100000:2.0:1789760792.932307:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863189760:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760792.932348:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1dd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.932364:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789760792.932369:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760792.932386:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1dd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.932403:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1dd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.951372:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1dd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.951452:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.951461:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.951469:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760792.951475:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.951484:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.951516:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760792.951524:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [73400320->74448895] (req 73400320->74448895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760792.951691:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863189760:12345-192.168.203.12@tcp:3:dd.500 Request processed in 19392us (185408us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760792.951701:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 202 00000100:00100000:2.0:1789760792.951708:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 397044981869 time 397045441870 state 0x2 ref 0 00000100:00100000:3.0:1789760792.956624:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760792.957288:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863189888 00000100:00100000:0.0:1789760792.957298:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863189888 00000100:00100000:0.0:1789760792.957353:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 397044981869 time 397045441870 state 0x0 ref 1 00000100:00100000:0.0:1789760792.957365:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 397245441870 time 397045441870 state 0x1 ref 1 00000100:00100000:2.0:1789760793.132425:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 397245441870 time 397245608129 state 0x0 ref 1 00000100:00100000:2.0:1789760793.132462:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d31ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863189888:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760793.132510:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1e4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.132531:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.132536:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.132543:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.132559:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.143534:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.143553:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1e4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.143563:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.143569:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760793.143574:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.143582:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.143602:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.143610:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [74448896->75497471] (req 74448896->75497471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.143766:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d31ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863189888:12345-192.168.203.12@tcp:3:dd.500 Request processed in 11317us (187146us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760793.143777:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 203 00000100:00100000:2.0:1789760793.143855:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 397245441870 time 397245608129 state 0x2 ref 0 00000100:00100000:1.0:1789760793.155905:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760793.156030:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863190016 00000100:00100000:3.0:1789760793.156041:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863190016 00000100:00100000:3.0:1789760793.156109:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 397245441870 time 397245608129 state 0x0 ref 1 00000100:00100000:3.0:1789760793.156121:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 397445608129 time 397245608129 state 0x1 ref 1 00000100:00100000:2.0:1789760793.167269:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df2687ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883065728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760793.167494:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760793.167959:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883065728 00000100:00100000:0.0:1789760793.167980:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883065728 00000100:00100000:0.0:1789760793.168031:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789760793.168041:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d662a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883065728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789760793.168076:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760793.168132:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d662a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883065728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760793.168140:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789760793.168343:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df2687ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883065728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760793.332666:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 397445608129 time 397445851609 state 0x0 ref 1 00000100:00100000:2.0:1789760793.332711:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863190016:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760793.332754:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1eb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.332772:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.332776:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.332782:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1eb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.332797:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1eb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.342556:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1eb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.342578:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1eb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.342586:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.342611:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760793.342617:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.342625:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.342644:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1eb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.342652:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [75497472->76546047] (req 75497472->76546047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.342728:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863190016:12345-192.168.203.12@tcp:3:dd.500 Request processed in 10039us (186828us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760793.342739:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 204 00000100:00100000:2.0:1789760793.342747:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 397445608129 time 397445851609 state 0x2 ref 0 00000100:00100000:0.0:1789760793.347030:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760793.347260:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863190144 00000100:00100000:2.0:1789760793.347269:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863190144 00000100:00100000:2.0:1789760793.347322:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 397445608129 time 397445851609 state 0x0 ref 1 00000100:00100000:2.0:1789760793.347335:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 397645851609 time 397445851609 state 0x1 ref 1 00000100:00100000:2.0:1789760793.533437:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 397645851609 time 397646611356 state 0x0 ref 1 00000100:00100000:2.0:1789760793.533470:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863190144:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760793.533525:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1f2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.533542:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.533546:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.533553:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.533567:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.542785:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.542830:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1f2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.542840:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.542847:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760793.542852:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.542863:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.542902:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.542909:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [76546048->77594623] (req 76546048->77594623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.543003:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863190144:12345-192.168.203.12@tcp:3:dd.500 Request processed in 9544us (195977us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760793.543014:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 205 00000100:00100000:2.0:1789760793.543022:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 397645851609 time 397646611356 state 0x2 ref 0 00000100:00100000:3.0:1789760793.549770:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760793.549886:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863190272 00000100:00100000:0.0:1789760793.549895:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863190272 00000100:00100000:0.0:1789760793.549957:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 397645851609 time 397646611356 state 0x0 ref 1 00000100:00100000:0.0:1789760793.550069:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 397846611356 time 397646611356 state 0x1 ref 1 00000100:00100000:2.0:1789760793.736817:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 397846611356 time 397849993227 state 0x0 ref 1 00000100:00100000:2.0:1789760793.736850:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d31f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863190272:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760793.736893:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1f9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.736910:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.736914:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.736920:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.737122:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.760243:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.760263:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1f9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.760272:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.760279:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760793.760284:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.760293:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.760312:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.760320:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af1f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [77594624->78643199] (req 77594624->78643199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.760600:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d31f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863190272:12345-192.168.203.12@tcp:3:dd.500 Request processed in 23761us (210832us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760793.760612:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 206 00000100:00100000:2.0:1789760793.760631:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 397846611356 time 397849993227 state 0x2 ref 0 00000100:00100000:1.0:1789760793.772717:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760793.773049:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863190400 00000100:00100000:2.0:1789760793.773060:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863190400 00000100:00100000:2.0:1789760793.773113:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 397846611356 time 397849993227 state 0x0 ref 1 00000100:00100000:2.0:1789760793.773126:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 398049993227 time 397849993227 state 0x1 ref 1 00010000:00010000:0.0:1789760793.807084:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760793.936914:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 398049993227 time 398050098451 state 0x0 ref 1 00000100:00100000:2.0:1789760793.936958:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863190400:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760793.937000:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af200 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.937020:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789760793.937027:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760793.937033:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af200 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.937048:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af200 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.954045:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af200 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.954075:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af200 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.954085:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af200 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.954122:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760793.954128:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af200 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.954137:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af200 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.954156:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af200 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.954164:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af200 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [78643200->79691775] (req 78643200->79691775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760793.954262:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863190400:12345-192.168.203.12@tcp:3:dd.500 Request processed in 17326us (181548us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760793.954273:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 207 00000100:00100000:2.0:1789760793.954281:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 398049993227 time 398050098451 state 0x2 ref 0 00000100:00100000:0.0:1789760793.971227:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760793.973535:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863190528 00000100:00100000:2.0:1789760793.973549:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863190528 00000100:00100000:2.0:1789760793.973604:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 398049993227 time 398050098451 state 0x0 ref 1 00000100:00100000:2.0:1789760793.973616:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 398250098451 time 398050098451 state 0x1 ref 1 00000100:00100000:2.0:1789760794.137030:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 398250098451 time 398250215746 state 0x0 ref 1 00000100:00100000:2.0:1789760794.137180:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863190528:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760794.137233:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af207 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.137251:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760794.137255:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760794.137261:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af207 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.137276:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af207 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789760794.137510:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789760794.162748:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af207 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.162768:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af207 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.162778:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af207 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.162785:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760794.162790:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af207 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.162799:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af207 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.162860:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af207 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.162869:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af207 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [79691776->80740351] (req 79691776->80740351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760794.162955:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863190528:12345-192.168.203.12@tcp:3:dd.500 Request processed in 25902us (191799us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760794.162965:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 208 00000100:00100000:2.0:1789760794.162973:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 398250098451 time 398250215746 state 0x2 ref 0 00000100:00100000:1.0:1789760794.167525:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760794.167833:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863190656 00000100:00100000:0.0:1789760794.167843:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863190656 00000100:00100000:0.0:1789760794.167897:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 398250098451 time 398250215746 state 0x0 ref 1 00000100:00100000:0.0:1789760794.167910:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 398450215746 time 398250215746 state 0x1 ref 1 00000100:00100000:2.0:1789760794.339905:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 398450215746 time 398453092159 state 0x0 ref 1 00000100:00100000:2.0:1789760794.339951:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863190656:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760794.340003:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af20e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.340020:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760794.340025:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760794.340031:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af20e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.340045:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af20e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.360172:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af20e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.360194:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af20e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.360204:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af20e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.360212:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760794.360218:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af20e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.360228:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af20e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.360246:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af20e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.360254:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af20e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [80740352->81788927] (req 80740352->81788927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760794.360328:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863190656:12345-192.168.203.12@tcp:3:dd.500 Request processed in 20401us (192807us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760794.360339:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 209 00000100:00100000:2.0:1789760794.360360:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 398450215746 time 398453092159 state 0x2 ref 0 00000100:00100000:1.0:1789760794.365126:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760794.365249:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863190784 00000100:00100000:3.0:1789760794.365260:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863190784 00000100:00100000:3.0:1789760794.365358:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 398450215746 time 398453092159 state 0x0 ref 1 00000100:00100000:3.0:1789760794.365380:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 398653092159 time 398453092159 state 0x1 ref 1 00000100:00100000:2.0:1789760794.543415:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 398653092159 time 398656599815 state 0x0 ref 1 00000100:00100000:2.0:1789760794.543449:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863190784:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760794.543491:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af215 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.543709:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760794.543715:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760794.543723:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af215 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.543738:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af215 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.564955:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af215 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.564975:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af215 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.564984:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af215 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.564992:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760794.564997:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af215 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.565025:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af215 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.565713:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af215 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.565725:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af215 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [81788928->82837503] (req 81788928->82837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760794.565859:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863190784:12345-192.168.203.12@tcp:3:dd.500 Request processed in 22420us (200736us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760794.565871:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 210 00000100:00100000:2.0:1789760794.565880:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 398653092159 time 398656599815 state 0x2 ref 0 00000100:00100000:0.0:1789760794.581300:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760794.581501:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863190912 00000100:00100000:1.0:1789760794.584518:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863190912 00000100:00100000:1.0:1789760794.584603:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 398653092159 time 398656599815 state 0x0 ref 1 00000100:00100000:1.0:1789760794.584616:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 398856599815 time 398656599815 state 0x1 ref 1 00000100:00100000:2.0:1789760794.746223:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 398856599815 time 398859408130 state 0x0 ref 1 00000100:00100000:2.0:1789760794.746258:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df2687ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863190912:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760794.746299:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af21c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.746316:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760794.746321:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760794.746328:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af21c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.746360:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af21c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.754979:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af21c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.755008:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af21c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.755019:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af21c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.755029:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760794.755036:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af21c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.755049:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af21c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.755076:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af21c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.755086:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af21c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [82837504->83886079] (req 82837504->83886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760794.755235:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df2687ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863190912:12345-192.168.203.12@tcp:3:dd.500 Request processed in 8987us (173937us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760794.755249:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 211 00000100:00100000:2.0:1789760794.755261:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 398856599815 time 398859408130 state 0x2 ref 0 00000100:00100000:0.0:1789760794.760787:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760794.761043:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863191040 00000100:00100000:2.0:1789760794.761061:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863191040 00000100:00100000:2.0:1789760794.761365:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 398856599815 time 398859408130 state 0x0 ref 1 00000100:00100000:2.0:1789760794.761379:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 399059408130 time 398859408130 state 0x1 ref 1 00010000:00010000:2.0:1789760794.831357:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760794.946338:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 399059408130 time 399059524619 state 0x0 ref 1 00000100:00100000:2.0:1789760794.946373:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24303ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863191040:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760794.946537:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af223 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.946556:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789760794.946561:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760794.946568:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af223 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.946586:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af223 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.960705:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af223 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.960743:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af223 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.960753:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af223 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.960760:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760794.960764:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af223 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.960773:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af223 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.960792:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af223 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760794.960799:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af223 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760794.960898:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24303ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863191040:12345-192.168.203.12@tcp:3:dd.500 Request processed in 14538us (200116us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760794.960908:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 212 00000100:00100000:2.0:1789760794.960916:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 399059408130 time 399059524619 state 0x2 ref 0 00000100:00100000:0.0:1789760794.968868:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760794.969038:0:11797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863191168 00000100:00100000:3.0:1789760794.969050:0:11797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863191168 00000100:00100000:3.0:1789760794.969108:0:11797:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 399059408130 time 399059524619 state 0x0 ref 1 00000100:00100000:3.0:1789760794.969120:0:11797:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 399259524619 time 399059524619 state 0x1 ref 1 00000100:00100000:2.0:1789760795.146581:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 399259524619 time 399259767232 state 0x0 ref 1 00000100:00100000:2.0:1789760795.146626:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24303ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863191168:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760795.146666:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af22a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.146682:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760795.146687:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760795.146693:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af22a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.146707:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af22a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.159547:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af22a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.159569:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af22a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.159578:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af22a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.159585:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760795.159590:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af22a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.159599:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af22a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.159635:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af22a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.159643:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af22a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760795.159725:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24303ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863191168:12345-192.168.203.12@tcp:3:dd.500 Request processed in 13108us (190862us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760795.159735:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 213 00000100:00100000:2.0:1789760795.159743:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 399259524619 time 399259767232 state 0x2 ref 0 00000100:00100000:3.0:1789760795.166921:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760795.167027:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863191296 00000100:00100000:1.0:1789760795.167038:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863191296 00000100:00100000:1.0:1789760795.167095:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 399259524619 time 399259767232 state 0x0 ref 1 00000100:00100000:1.0:1789760795.167109:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 399459767232 time 399259767232 state 0x1 ref 1 00000100:00100000:0.0:1789760795.251194:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760795.251247:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760795.251280:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760795.251406:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863191680 00000100:00100000:2.0:1789760795.251418:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863191680 00000100:00100000:2.0:1789760795.251477:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863191552 00000100:00100000:2.0:1789760795.251480:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863191552 00000100:00100000:2.0:1789760795.251517:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 208 00000100:00100000:2.0:1789760795.251527:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24303c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2348:x1876699863191680:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1789760795.251595:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24303c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c264b2a-20ff-4f4b-947d-777de3ce523e+5:2348:x1876699863191680:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 69us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760795.251603:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 208 00000100:00100000:2.0:1789760795.251621:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 209 00000100:00100000:2.0:1789760795.251627:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24303f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+9:2348:x1876699863191552:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1789760795.251651:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24303f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+9:2348:x1876699863191552:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760795.251657:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 209 00000100:00080000:0.0:1789760795.252942:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760795.253070:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863191424 00000100:00100000:3.0:1789760795.253077:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863191424 00000100:00100000:3.0:1789760795.253130:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 295 00000100:00100000:3.0:1789760795.253140:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2348:x1876699863191424:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1789760795.254096:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:940dde3d-5669-46e3-a0d8-2c83dea985ec+13:2348:x1876699863191424:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 955us (2909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760795.254104:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 295 00000100:00100000:2.0:1789760795.346740:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 399459767232 time 399459925315 state 0x0 ref 1 00000100:00100000:2.0:1789760795.346775:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d31c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863191296:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760795.346856:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af231 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.346874:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760795.346878:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760795.346885:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af231 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.346900:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af231 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.359441:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af231 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.359462:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af231 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.359471:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af231 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.359478:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760795.359482:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af231 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.359514:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af231 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.359534:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af231 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.359541:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af231 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760795.359717:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d31c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863191296:12345-192.168.203.12@tcp:3:dd.500 Request processed in 12954us (192798us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760795.359730:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 214 00000100:00100000:2.0:1789760795.359738:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 399459767232 time 399459925315 state 0x2 ref 0 00000100:00100000:1.0:1789760795.368500:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760795.368722:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863191808 00000100:00100000:2.0:1789760795.368733:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863191808 00000100:00100000:2.0:1789760795.368791:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 399459767232 time 399459925315 state 0x0 ref 1 00000100:00100000:2.0:1789760795.368826:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 399659925315 time 399459925315 state 0x1 ref 1 00000100:00100000:2.0:1789760795.546872:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 399659925315 time 399660058124 state 0x0 ref 1 00000100:00100000:2.0:1789760795.546905:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863191808:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760795.546991:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af238 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.547025:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760795.547030:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760795.547037:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af238 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.547051:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af238 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.559530:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af238 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.559550:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af238 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.559576:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af238 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.559583:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760795.559588:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af238 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.559596:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af238 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.559613:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af238 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.559621:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000548b137a/0x3e099f5ef04af238 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [87031808->88080383] (req 87031808->88080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760795.559704:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863191808:12345-192.168.203.12@tcp:3:dd.500 Request processed in 12811us (191210us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760795.559715:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 215 00000100:00100000:3.0:1789760795.559723:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 399659925315 time 399660058124 state 0x2 ref 0 00000100:00100000:2.0:1789760795.565911:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760795.566004:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863191936 00000100:00100000:0.0:1789760795.566027:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863191936 00000100:00100000:0.0:1789760795.566076:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 399659925315 time 399660058124 state 0x0 ref 1 00000100:00100000:0.0:1789760795.566089:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 399860058124 time 399660058124 state 0x1 ref 1 00000100:00100000:2.0:1789760795.747019:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 399860058124 time 399860195092 state 0x0 ref 1 00000100:00100000:2.0:1789760795.747056:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d660700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863191936:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760795.747099:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04af23f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.747115:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760795.747120:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760795.747127:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04af23f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.747140:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04af23f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.757902:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04af23f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.757931:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04af23f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.757955:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04af23f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.757962:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f3800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760795.757967:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04af23f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.757975:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04af23f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.757993:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04af23f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760795.757999:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000637d9c4a/0x3e099f5ef04af23f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760795.758097:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d660700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863191936:12345-192.168.203.12@tcp:3:dd.500 Request processed in 11055us (192190us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760795.758107:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 216 00000100:00100000:3.0:1789760795.758115:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 399860058124 time 399860195092 state 0x2 ref 0 00000100:00100000:1.0:1789760795.771198:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760795.772448:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863192064 00000100:00100000:3.0:1789760795.772460:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863192064 00000100:00100000:3.0:1789760795.772519:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 399860058124 time 399860195092 state 0x0 ref 1 00000100:00100000:3.0:1789760795.772531:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 400060195092 time 399860195092 state 0x1 ref 1 00010000:00010000:1.0:1789760795.855093:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760795.947124:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 400060195092 time 400060306378 state 0x0 ref 1 00000100:00100000:2.0:1789760795.947162:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863192064:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760795.947221:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000779651c/0x3e099f5ef04af246 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.947240:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789760795.947244:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760795.947250:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000779651c/0x3e099f5ef04af246 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.947265:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000779651c/0x3e099f5ef04af246 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.971517:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000779651c/0x3e099f5ef04af246 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.971538:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000779651c/0x3e099f5ef04af246 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.971547:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000779651c/0x3e099f5ef04af246 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.971555:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760795.971560:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000779651c/0x3e099f5ef04af246 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.971569:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000779651c/0x3e099f5ef04af246 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.971609:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000779651c/0x3e099f5ef04af246 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.971617:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000779651c/0x3e099f5ef04af246 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760795.971702:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863192064:12345-192.168.203.12@tcp:3:dd.500 Request processed in 24555us (200511us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760795.971714:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 217 00000100:00100000:2.0:1789760795.971723:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 400060195092 time 400060306378 state 0x2 ref 0 00000100:00100000:0.0:1789760795.989500:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760795.989597:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863192192 00000100:00100000:2.0:1789760795.989607:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863192192 00000100:00100000:2.0:1789760795.989661:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 400060195092 time 400060306378 state 0x0 ref 1 00000100:00100000:2.0:1789760795.989672:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 400260306378 time 400060306378 state 0x1 ref 1 00000100:00100000:3.0:1789760796.149139:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 400260306378 time 400262317737 state 0x0 ref 1 00000100:00100000:3.0:1789760796.149223:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24303df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863192192:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:3.0:1789760796.149283:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af24d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.149305:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760796.149310:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760796.149316:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af24d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.149331:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af24d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789760796.153058:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789760796.169386:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af24d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.169413:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af24d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.169424:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af24d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.169432:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df246237400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760796.169437:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af24d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.169468:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af24d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.169489:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af24d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.169497:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af24d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [90177536->91226111] (req 90177536->91226111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760796.169675:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24303df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863192192:12345-192.168.203.12@tcp:3:dd.500 Request processed in 20509us (180180us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760796.169686:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 218 00000100:00100000:3.0:1789760796.169694:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 400260306378 time 400262317737 state 0x2 ref 0 00000100:00100000:0.0:1789760796.175594:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760796.175686:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863192320 00000100:00100000:2.0:1789760796.175697:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863192320 00000100:00100000:2.0:1789760796.175754:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 400260306378 time 400262317737 state 0x0 ref 1 00000100:00100000:2.0:1789760796.175767:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 400462317737 time 400262317737 state 0x1 ref 1 00000100:00100000:2.0:1789760796.239314:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df26d31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883065856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789760796.239395:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760796.239611:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883065856 00000100:00100000:0.0:1789760796.239622:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883065856 00000100:00080000:3.0:1789760796.239666:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760796.239697:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789760796.239709:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d663480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883065856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789760796.239744:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 241893376 pending 0 free 3754950656 avail 3752853504 00000100:00100000:0.0:1789760796.241344:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d663480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883065856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1631us (1942us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760796.241357:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789760796.243439:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df26d31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883065856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789760796.349281:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 400462317737 time 400462464113 state 0x0 ref 1 00000100:00100000:3.0:1789760796.349316:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24303e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863192320:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:3.0:1789760796.349365:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af254 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.349531:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760796.349536:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760796.349542:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af254 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.349578:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af254 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.363326:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af254 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.363345:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af254 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.363354:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af254 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.363361:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df246237400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760796.363365:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af254 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.363374:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af254 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.363392:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af254 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.363399:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af254 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [91226112->92274687] (req 91226112->92274687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760796.363554:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24303e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863192320:12345-192.168.203.12@tcp:3:dd.500 Request processed in 14251us (187964us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760796.363564:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 219 00000100:00100000:3.0:1789760796.363574:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 400462317737 time 400462464113 state 0x2 ref 0 00000100:00100000:0.0:1789760796.374787:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760796.375050:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863192448 00000100:00100000:2.0:1789760796.375076:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863192448 00000100:00100000:2.0:1789760796.375132:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 400462317737 time 400462464113 state 0x0 ref 1 00000100:00100000:2.0:1789760796.375145:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 400662464113 time 400462464113 state 0x1 ref 1 00000100:00100000:2.0:1789760796.549389:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 400662464113 time 400662573446 state 0x0 ref 1 00000100:00100000:2.0:1789760796.549424:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24303d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863192448:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760796.549469:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000779651c/0x3e099f5ef04af25b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.549488:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.549493:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760796.549499:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000779651c/0x3e099f5ef04af25b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760796.549517:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000779651c/0x3e099f5ef04af25b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.562784:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000779651c/0x3e099f5ef04af25b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.562835:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000779651c/0x3e099f5ef04af25b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.562845:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000779651c/0x3e099f5ef04af25b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.562852:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2517f2800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760796.562856:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000779651c/0x3e099f5ef04af25b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.562881:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000779651c/0x3e099f5ef04af25b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.562901:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000779651c/0x3e099f5ef04af25b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760796.562909:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000779651c/0x3e099f5ef04af25b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760796.563071:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24303d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863192448:12345-192.168.203.12@tcp:3:dd.500 Request processed in 13659us (188287us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760796.563083:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 220 00000100:00100000:0.0:1789760796.563089:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 400662464113 time 400662573446 state 0x2 ref 0 00000100:00100000:0.0:1789760796.571101:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760796.571209:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863192576 00000100:00100000:2.0:1789760796.571220:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863192576 00000100:00100000:2.0:1789760796.571279:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 400662464113 time 400662573446 state 0x0 ref 1 00000100:00100000:2.0:1789760796.571294:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 400862573446 time 400662573446 state 0x1 ref 1 00000100:00100000:3.0:1789760796.749759:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 400862573446 time 400862944783 state 0x0 ref 1 00000100:00100000:3.0:1789760796.749794:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24303ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863192576:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:3.0:1789760796.749882:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af262 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.749900:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760796.749905:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760796.749911:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af262 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.749936:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af262 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.767300:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af262 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.767320:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af262 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.767349:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af262 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.767356:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df246237400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760796.767362:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af262 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.767381:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af262 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.767446:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af262 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.767456:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af262 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [93323264->94371839] (req 93323264->94371839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760796.767787:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24303ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863192576:12345-192.168.203.12@tcp:3:dd.500 Request processed in 18005us (196693us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760796.767798:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 221 00000100:00100000:3.0:1789760796.767890:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 400862573446 time 400862944783 state 0x2 ref 0 00000100:00100000:1.0:1789760796.777488:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760796.777628:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863192704 00000100:00100000:2.0:1789760796.777638:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863192704 00000100:00100000:2.0:1789760796.777689:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 400862573446 time 400862944783 state 0x0 ref 1 00000100:00100000:2.0:1789760796.777701:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 401062944783 time 400862944783 state 0x1 ref 1 00010000:00010000:0.0:1789760796.878968:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760796.954779:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 401062944783 time 401067964026 state 0x0 ref 1 00000100:00100000:3.0:1789760796.954875:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863192704:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:3.0:1789760796.954929:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af269 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.954958:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789760796.954962:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760796.954969:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af269 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.954985:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af269 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.963150:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af269 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.963171:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af269 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.963181:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af269 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.963188:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df246237400 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760796.963193:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af269 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.963202:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af269 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.963221:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af269 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760796.963248:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c60f0936/0x3e099f5ef04af269 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [94371840->95420415] (req 94371840->95420415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760796.963339:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863192704:12345-192.168.203.12@tcp:3:dd.500 Request processed in 8536us (185854us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760796.963350:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 222 00000100:00100000:3.0:1789760796.963359:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 401062944783 time 401067964026 state 0x2 ref 0 00000100:00100000:1.0:1789760796.970247:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760796.970359:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863192832 00000100:00100000:2.0:1789760796.970369:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863192832 00000100:00100000:2.0:1789760796.970421:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 401062944783 time 401067964026 state 0x0 ref 1 00000100:00100000:2.0:1789760796.970434:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 401267964026 time 401067964026 state 0x1 ref 1 00000100:00100000:0.0:1789760797.158875:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 401267964026 time 401272061182 state 0x0 ref 1 00000100:00100000:0.0:1789760797.158925:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863192832:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760797.158969:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007484e4af/0x3e099f5ef04af270 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.158985:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760797.158990:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760797.158996:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007484e4af/0x3e099f5ef04af270 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.159022:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007484e4af/0x3e099f5ef04af270 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.177009:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007484e4af/0x3e099f5ef04af270 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.177028:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007484e4af/0x3e099f5ef04af270 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.177042:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007484e4af/0x3e099f5ef04af270 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.177050:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25954b200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:0.0:1789760797.177055:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007484e4af/0x3e099f5ef04af270 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.177064:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007484e4af/0x3e099f5ef04af270 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.177084:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007484e4af/0x3e099f5ef04af270 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.177092:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007484e4af/0x3e099f5ef04af270 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [95420416->96468991] (req 95420416->96468991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760797.177202:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863192832:12345-192.168.203.12@tcp:3:dd.500 Request processed in 18296us (206959us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789760797.177213:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 223 00000100:00100000:0.0:1789760797.177220:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 401267964026 time 401272061182 state 0x2 ref 0 00000100:00100000:1.0:1789760797.189921:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760797.190408:0:11798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863192960 00000100:00100000:2.0:1789760797.190418:0:11798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863192960 00000100:00100000:2.0:1789760797.190466:0:11798:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 401267964026 time 401272061182 state 0x0 ref 1 00000100:00100000:2.0:1789760797.190479:0:11798:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 401472061182 time 401272061182 state 0x1 ref 1 00000100:00100000:3.0:1789760797.359137:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 401472061182 time 401472322473 state 0x0 ref 1 00000100:00100000:3.0:1789760797.359170:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863192960:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:3.0:1789760797.359211:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04af277 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.359228:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760797.359232:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760797.359238:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04af277 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.359252:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04af277 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.378938:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04af277 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.378991:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04af277 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.378999:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04af277 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.379007:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241538e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760797.379012:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04af277 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.379020:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04af277 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.379040:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04af277 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.379047:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04af277 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [96468992->97517567] (req 96468992->97517567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760797.379133:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863192960:12345-192.168.203.12@tcp:3:dd.500 Request processed in 19975us (189226us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760797.379329:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 224 00000100:00100000:3.0:1789760797.379338:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 401472061182 time 401472322473 state 0x2 ref 0 00000100:00100000:2.0:1789760797.389257:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760797.389434:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863193088 00000100:00100000:0.0:1789760797.389445:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863193088 00000100:00100000:0.0:1789760797.389498:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 401472061182 time 401472322473 state 0x0 ref 1 00000100:00100000:0.0:1789760797.389511:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 401672322473 time 401472322473 state 0x1 ref 1 00000100:00100000:3.0:1789760797.560717:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 401672322473 time 401673902742 state 0x0 ref 1 00000100:00100000:3.0:1789760797.560763:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d661f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863193088:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:3.0:1789760797.560826:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04af27e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.560844:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760797.560848:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760797.560854:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04af27e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.560867:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04af27e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.581495:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04af27e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.581522:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04af27e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.581532:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04af27e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.581538:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241538e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760797.581543:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04af27e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.581552:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04af27e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.581596:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04af27e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.581603:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04af27e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [97517568->98566143] (req 97517568->98566143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760797.581784:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d661f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863193088:12345-192.168.203.12@tcp:3:dd.500 Request processed in 21027us (192534us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760797.581796:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 225 00000100:00100000:3.0:1789760797.581837:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 401672322473 time 401673902742 state 0x2 ref 0 00000100:00100000:1.0:1789760797.597515:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760797.597989:0:11800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863193216 00000100:00100000:2.0:1789760797.598000:0:11800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863193216 00000100:00100000:2.0:1789760797.598446:0:11800:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 401672322473 time 401673902742 state 0x0 ref 1 00000100:00100000:2.0:1789760797.598459:0:11800:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 401873902742 time 401673902742 state 0x1 ref 1 00000100:00100000:0.0:1789760797.761267:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 401873902742 time 401874452558 state 0x0 ref 1 00000100:00100000:0.0:1789760797.761300:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863193216:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:0.0:1789760797.761344:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007484e4af/0x3e099f5ef04af285 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.761361:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760797.761365:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789760797.761371:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007484e4af/0x3e099f5ef04af285 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760797.761385:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007484e4af/0x3e099f5ef04af285 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760797.775232:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df24303e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883066368:0@lo:400:kworker.0 00000100:00100000:1.0:1789760797.775282:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df24303c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883065984:0@lo:400:kworker.0 00000100:00100000:0.0:1789760797.775335:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760797.775335:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760797.775448:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df24303fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883066240:0@lo:400:kworker.0 00000100:00100000:0.0:1789760797.775761:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df24303f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883066112:0@lo:400:kworker.0 00000100:00100000:0.0:1789760797.775825:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760797.775847:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df24303d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883066624:0@lo:400:kworker.0 00000100:00100000:0.0:1789760797.775884:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760797.775938:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883065984 00000100:00100000:0.0:1789760797.775946:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883065984 00000100:00100000:0.0:1789760797.775991:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1789760797.776000:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df247883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883065984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760797.776047:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df247883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e2780560-8e82-4256-94b0-2e524f3bed06+19:3310:x1876699883065984:12345-0@lo:400:kworker.0 Request processed in 48us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760797.776054:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1789760797.776094:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883066112 00000100:00100000:0.0:1789760797.776098:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883066112 00000100:00100000:0.0:1789760797.777521:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789760797.777535:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24303ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883066112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760797.777606:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24303ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876699883066112:12345-0@lo:400:kworker.0 Request processed in 75us (1780us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760797.777613:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789760797.778322:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df24303f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876699883066112:0@lo:400:kworker.0 00000100:00100000:0.0:1789760797.778383:0:12459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883066368 00000100:00100000:0.0:1789760797.778388:0:12459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883066368 00000100:00100000:0.0:1789760797.778421:0:12459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883066624 00000100:00100000:0.0:1789760797.778424:0:12459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883066624 00000100:00100000:0.0:1789760797.778453:0:12459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789760797.778460:0:12459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24303d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883066368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760797.778523:0:12459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24303d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3309:x1876699883066368:12345-0@lo:400:kworker.0 Request processed in 63us (3193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760797.778530:0:12459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789760797.778543:0:12459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789760797.778550:0:12459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24303f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883066624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760797.778582:0:12459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24303f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3311:x1876699883066624:12345-0@lo:400:kworker.0 Request processed in 33us (2698us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760797.778588:0:12459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789760797.778616:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df24303d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1876699883066624:0@lo:400:kworker.0 00000100:00100000:0.0:1789760797.778756:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df24303e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1876699883066368:0@lo:400:kworker.0 00000100:00080000:0.0:1789760797.778822:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789760797.780568:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df24303c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e2780560-8e82-4256-94b0-2e524f3bed06:3310:1876699883065984:0@lo:400:kworker.0 00000100:00100000:1.0:1789760797.780585:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df24303dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1876699883066496:0@lo:400:kworker.0 00000100:00100000:1.0:1789760797.780720:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760797.782347:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883066496 00000100:00100000:0.0:1789760797.782359:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883066496 00000100:00100000:0.0:1789760797.782514:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789760797.782527:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876699883066496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760797.782617:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876699883066496:12345-0@lo:400:kworker.0 Request processed in 94us (1897us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760797.782624:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789760797.782786:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df24303dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1876699883066496:0@lo:400:kworker.0 00000100:00100000:3.0:1789760797.783695:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760797.783904:0:7279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883066240 00000100:00100000:0.0:1789760797.783919:0:7279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883066240 00000100:00080000:1.0:1789760797.787315:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760797.792319:0:7279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789760797.792333:0:7279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d31ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883066240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789760797.792434:0:7279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d31ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876699883066240:12345-0@lo:400:kworker.0 Request processed in 104us (8740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760797.792455:0:7279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789760797.793095:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df24303fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1876699883066240:0@lo:400:kworker.0 00010000:00010000:2.0:1789760797.797569:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007484e4af/0x3e099f5ef04af285 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.797588:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007484e4af/0x3e099f5ef04af285 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.797598:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007484e4af/0x3e099f5ef04af285 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.797606:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df25954b200 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760797.797610:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007484e4af/0x3e099f5ef04af285 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.797632:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007484e4af/0x3e099f5ef04af285 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.797650:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007484e4af/0x3e099f5ef04af285 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.797658:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007484e4af/0x3e099f5ef04af285 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [98566144->99614719] (req 98566144->99614719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760797.797738:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863193216:12345-192.168.203.12@tcp:3:dd.500 Request processed in 36449us (200228us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760797.797749:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 226 00000100:00100000:2.0:1789760797.797756:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 401873902742 time 401874452558 state 0x2 ref 0 00000100:00100000:1.0:1789760797.802719:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760797.804871:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863193344 00000100:00100000:3.0:1789760797.804885:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863193344 00000100:00100000:3.0:1789760797.805292:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 401873902742 time 401874452558 state 0x0 ref 1 00000100:00100000:3.0:1789760797.805305:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 402074452558 time 401874452558 state 0x1 ref 1 00010000:00010000:2.0:1789760797.903047:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760797.961472:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 402074452558 time 402074658219 state 0x0 ref 1 00000100:00100000:3.0:1789760797.961504:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863193344:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:3.0:1789760797.961548:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04af28c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.961595:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789760797.961599:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760797.961606:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04af28c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760797.961619:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04af28c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.984897:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04af28c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.984925:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04af28c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.984933:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04af28c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.984941:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df241538e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760797.984946:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04af28c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.984973:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04af28c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.984992:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04af28c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760797.985000:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009832b5e8/0x3e099f5ef04af28c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760797.985085:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863193344:12345-192.168.203.12@tcp:3:dd.500 Request processed in 23592us (182371us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760797.985096:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 227 00000100:00100000:2.0:1789760797.985103:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 402074452558 time 402074658219 state 0x2 ref 0 00000100:00100000:0.0:1789760797.992504:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760797.992620:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863193472 00000100:00100000:1.0:1789760797.992630:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863193472 00000100:00100000:1.0:1789760797.992687:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 402074452558 time 402074658219 state 0x0 ref 1 00000100:00100000:1.0:1789760797.992701:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 402274658219 time 402074658219 state 0x1 ref 1 00000100:00100000:3.0:1789760798.161640:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 402274658219 time 402274825917 state 0x0 ref 1 00000100:00080000:2.0:1789760798.161713:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760798.161749:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24303dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863193472:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:3.0:1789760798.161793:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d8034bc6/0x3e099f5ef04af293 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.161853:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760798.161857:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760798.161864:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8034bc6/0x3e099f5ef04af293 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.161878:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8034bc6/0x3e099f5ef04af293 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.178400:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d8034bc6/0x3e099f5ef04af293 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.178419:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8034bc6/0x3e099f5ef04af293 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.178442:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8034bc6/0x3e099f5ef04af293 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.178450:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c4800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760798.178454:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8034bc6/0x3e099f5ef04af293 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.178463:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8034bc6/0x3e099f5ef04af293 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.178482:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8034bc6/0x3e099f5ef04af293 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.178489:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8034bc6/0x3e099f5ef04af293 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760798.178570:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24303dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2348:x1876699863193472:12345-192.168.203.12@tcp:3:dd.500 Request processed in 16910us (186076us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760798.178588:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 228 00000100:00100000:3.0:1789760798.178596:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 402274658219 time 402274825917 state 0x2 ref 0 00000100:00100000:0.0:1789760798.188729:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760798.188843:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863193600 00000100:00100000:3.0:1789760798.188853:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863193600 00000100:00100000:3.0:1789760798.188918:0:6698:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 402274658219 time 402274825917 state 0x0 ref 1 00000100:00100000:3.0:1789760798.188938:0:6698:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 402474825917 time 402274825917 state 0x1 ref 1 00000100:00100000:3.0:1789760798.288105:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df24303d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883066752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789760798.288178:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760798.288396:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699883066752 00000100:00100000:1.0:1789760798.288404:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699883066752 00000100:00100000:1.0:1789760798.288498:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789760798.288507:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d31c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883066752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789760798.288541:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760798.288653:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d31c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876699883066752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 147us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760798.288661:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789760798.288725:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df24303d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1876699883066752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789760798.361852:0:6699:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 402474825917 time 402475037338 state 0x0 ref 1 00000100:00100000:2.0:1789760798.361887:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24303e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863193600:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760798.362856:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af29a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.362876:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760798.362891:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760798.362898:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af29a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.362949:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af29a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.372001:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af29a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.372022:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af29a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.372031:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af29a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.372039:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240030e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760798.372044:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af29a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.372053:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af29a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.372075:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af29a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.372083:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af29a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [101711872->102760447] (req 101711872->102760447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760798.372209:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24303e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1da0113a-370d-4d79-883c-54efc174697f+6:2351:x1876699863193600:12345-192.168.203.12@tcp:3:dd.500 Request processed in 10333us (183483us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760798.372219:0:6699:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 229 00000100:00100000:2.0:1789760798.372227:0:6699:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 402474825917 time 402475037338 state 0x2 ref 0 00000100:00100000:0.0:1789760798.377269:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760798.377351:0:11801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863193728 00000100:00100000:3.0:1789760798.377359:0:11801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863193728 00000100:00100000:3.0:1789760798.377411:0:11801:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 402474825917 time 402475037338 state 0x0 ref 1 00000100:00100000:3.0:1789760798.377424:0:11801:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 402675037338 time 402475037338 state 0x1 ref 1 00000100:00100000:2.0:1789760798.563214:0:6700:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 402675037338 time 402676399922 state 0x0 ref 1 00000100:00100000:2.0:1789760798.563247:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24303f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863193728:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:2.0:1789760798.563290:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af2a1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.563306:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760798.563310:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789760798.563316:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af2a1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.563330:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af2a1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.589846:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af2a1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.589865:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af2a1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.589891:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af2a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.589897:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df240030e00 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:2.0:1789760798.590379:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af2a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.590393:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af2a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.590414:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af2a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.590422:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2eccfd4/0x3e099f5ef04af2a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [102760448->103809023] (req 102760448->103809023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760798.590564:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24303f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1da0113a-370d-4d79-883c-54efc174697f+6:2349:x1876699863193728:12345-192.168.203.12@tcp:3:dd.500 Request processed in 27328us (213297us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789760798.590575:0:6700:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 230 00000100:00100000:2.0:1789760798.590582:0:6700:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 402675037338 time 402676399922 state 0x2 ref 0 00000100:00100000:1.0:1789760798.604160:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760798.604369:0:11796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863193856 00000100:00100000:0.0:1789760798.604381:0:11796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863193856 00000100:00100000:0.0:1789760798.604508:0:11796:0:(nrs_tbf.c:1223:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 402675037338 time 402676399922 state 0x0 ref 1 00000100:00100000:0.0:1789760798.604521:0:11796:0:(nrs_tbf.c:2409:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 402876399922 time 402676399922 state 0x1 ref 1 00000100:00100000:3.0:1789760798.763549:0:11799:0:(nrs_tbf.c:2333:nrs_tbf_req_get()) ost_io.0 NRS: TBF dequeues: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 402876399922 time 402876734218 state 0x0 ref 1 00000100:00100000:3.0:1789760798.763596:0:11799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df27d0a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863193856:12345-192.168.203.12@tcp:3:dd.500 00010000:00010000:3.0:1789760798.763641:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d8034bc6/0x3e099f5ef04af2a8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.763659:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760798.763664:0:11799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789760798.763670:0:11799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8034bc6/0x3e099f5ef04af2a8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.763684:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8034bc6/0x3e099f5ef04af2a8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.778349:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d8034bc6/0x3e099f5ef04af2a8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.778369:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8034bc6/0x3e099f5ef04af2a8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.778393:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8034bc6/0x3e099f5ef04af2a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.778400:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df2687c4800 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:3.0:1789760798.778405:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8034bc6/0x3e099f5ef04af2a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.778415:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8034bc6/0x3e099f5ef04af2a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.778435:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8034bc6/0x3e099f5ef04af2a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.778442:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8034bc6/0x3e099f5ef04af2a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [103809024->104857599] (req 103809024->104857599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760798.778525:0:11799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df27d0a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1da0113a-370d-4d79-883c-54efc174697f+6:2350:x1876699863193856:12345-192.168.203.12@tcp:3:dd.500 Request processed in 14942us (174373us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789760798.778536:0:11799:0:(nrs_tbf.c:2464:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.12@tcp, seq: 231 00000100:00100000:3.0:1789760798.778544:0:11799:0:(nrs_tbf.c:1203:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff8df277810200 key gid={500} rule@0xffff8df274bf2f00 gen 0 rate 5 depth 3 token 0 deadline 402876399922 time 402876734218 state 0x2 ref 0 00000100:00100000:0.0:1789760798.783092:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760798.783235:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863194112 00000100:00100000:3.0:1789760798.783246:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863194112 00000100:00080000:2.0:1789760798.783381:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760798.783474:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:3.0:1789760798.783486:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24767dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+9:11150:x1876699863194112:12345-192.168.203.12@tcp:35:dd.500 00000100:00100000:3.0:1789760798.783995:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24767dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+10:11150:x1876699863194112:12345-192.168.203.12@tcp:35:dd.500 Request processed in 510us (910us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1789760798.784004:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:0.0:1789760798.846538:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1789760798.846629:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863194240 00000100:00100000:2.0:1789760798.846638:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863194240 00000100:00100000:2.0:1789760798.846741:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:2.0:1789760798.846749:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24303c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1da0113a-370d-4d79-883c-54efc174697f+6:9586:x1876699863194240:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789760798.846773:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760798.846832:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033a92095/0x3e099f5ef04aefec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d37f expref: 6 pid: 12459 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.846852:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760798.846916:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24303c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1da0113a-370d-4d79-883c-54efc174697f+5:9586:x1876699863194240:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 165us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760798.846921:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:1.0:1789760798.860632:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760798.860698:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863194368 00000100:00100000:0.0:1789760798.860707:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863194368 00000100:00100000:2.0:1789760798.860966:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 145 00000100:00100000:2.0:1789760798.860979:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24626fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+10:10222:x1876699863194368:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1789760798.861002:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760798.861023:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0x3e099f5ef04af2af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d386 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.861103:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031000/0x3e099f5ef04af2b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.861117:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031000/0x3e099f5ef04af2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.861128:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031000/0x3e099f5ef04af2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760798.861161:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 16384 00000004:00200000:2.0:1789760798.861164:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789760798.861180:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031000/0x3e099f5ef04af2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.861206:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240030e00/0x3e099f5ef04af2af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d386 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.861240:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031000/0x3e099f5ef04af2b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d386 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760798.861246:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff8df250325b00) 00010000:00010000:2.0:1789760798.861249:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789760798.861251:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df240031000, rc 0) 00000100:00100000:2.0:1789760798.861319:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24626fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1da0113a-370d-4d79-883c-54efc174697f+11:10222:x1876699863194368:12345-192.168.203.12@tcp:101:bash.0 Request processed in 344us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760798.861330:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 145 00000100:00100000:0.0:1789760798.872461:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1789760798.872729:0:12529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863194624 00000100:00100000:1.0:1789760798.872739:0:12529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863194624 00000100:00100000:1.0:1789760798.872874:0:12529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 146 00000100:00100000:1.0:1789760798.872885:0:12529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df24303d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1da0113a-370d-4d79-883c-54efc174697f+11:11165:x1876699863194624:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:1.0:1789760798.872935:0:12529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760798.872955:0:12529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df25954f800/0x3e099f5ef04af2bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d38d expref: -99 pid: 12529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789760798.873058:0:12529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 16384 00010000:00010000:1.0:1789760798.873193:0:12529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df25954f800/0x3e099f5ef04af2bd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d38d expref: 13 pid: 12529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760798.873215:0:12529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df245dcc900) 00010000:00010000:1.0:1789760798.873218:0:12529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789760798.873223:0:12529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df25954f800/0x3e099f5ef04af2bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d38d expref: 13 pid: 12529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760798.873237:0:12529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df25954f800, rc 0) 00000100:00100000:1.0:1789760798.873303:0:12529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df24303d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1da0113a-370d-4d79-883c-54efc174697f+12:11165:x1876699863194624:12345-192.168.203.12@tcp:101:rm.0 Request processed in 420us (852us total) trans 4294967413 rc 301/301 00000100:00100000:1.0:1789760798.873311:0:12529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 146 00000100:00100000:2.0:1789760798.876965:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760798.877201:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863194752 00000100:00100000:0.0:1789760798.877211:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863194752 00000100:00100000:0.0:1789760798.877269:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:0.0:1789760798.877280:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+12:11165:x1876699863194752:12345-192.168.203.12@tcp:37:rm.0 00000100:00100000:0.0:1789760798.881718:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+12:11165:x1876699863194752:12345-192.168.203.12@tcp:37:rm.0 Request processed in 4430us (4750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760798.881731:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:1.0:1789760798.884068:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1789760798.884218:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863195008 00000100:00100000:3.0:1789760798.884229:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863195008 00000100:00100000:3.0:1789760798.884284:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:3.0:1789760798.884294:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+12:11165:x1876699863195008:12345-192.168.203.12@tcp:35:rm.0 00000100:00100000:3.0:1789760798.884544:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1da0113a-370d-4d79-883c-54efc174697f+13:11165:x1876699863195008:12345-192.168.203.12@tcp:35:rm.0 Request processed in 250us (484us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1789760798.884551:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:2.0:1789760798.886304:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760798.886436:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863195264 00000100:00100000:0.0:1789760798.886445:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863195264 00000100:00100000:0.0:1789760798.886527:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 147 00000100:00100000:0.0:1789760798.886536:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+13:11165:x1876699863195264:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:0.0:1789760798.886556:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760798.886588:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c800/0x3e099f5ef04af2cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb91f8c745ab2d394 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.886668:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2d800/0x3e099f5ef04af2d2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.886683:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2d800/0x3e099f5ef04af2d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.886694:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2d800/0x3e099f5ef04af2d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760798.886706:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 16384 00010000:00010000:0.0:1789760798.886857:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c800/0x3e099f5ef04af2cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d394 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.886876:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2d800/0x3e099f5ef04af2d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x13:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d394 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.886885:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff8df250325b00) 00010000:00010000:0.0:1789760798.886888:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789760798.886892:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df245d2d800, rc 0) 00000100:00100000:0.0:1789760798.886956:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+15:11165:x1876699863195264:12345-192.168.203.12@tcp:101:rm.0 Request processed in 421us (658us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1789760798.886963:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 147 00000100:00100000:2.0:1789760798.889179:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760798.889255:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863195392 00000100:00100000:0.0:1789760798.889265:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863195392 00000100:00100000:0.0:1789760798.889325:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 148 00000100:00100000:0.0:1789760798.889336:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+15:11165:x1876699863195392:12345-192.168.203.12@tcp:41:rm.0 00000004:00000024:0.0:1789760798.889424:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7614758912 avail 7610564608 00000100:00100000:0.0:1789760798.889493:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1da0113a-370d-4d79-883c-54efc174697f+15:11165:x1876699863195392:12345-192.168.203.12@tcp:41:rm.0 Request processed in 159us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760798.889501:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 148 00000100:00100000:1.0:1789760798.892232:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760798.892381:0:12529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863195648 00000100:00100000:0.0:1789760798.892389:0:12529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863195648 00000100:00100000:0.0:1789760798.892442:0:12529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 149 00000100:00100000:0.0:1789760798.892451:0:12529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1da0113a-370d-4d79-883c-54efc174697f+15:11165:x1876699863195648:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:0.0:1789760798.892500:0:12529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789760798.892529:0:12529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d800/0x3e099f5ef04aefde lrc: 0/0,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d378 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.892552:0:12529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df24627d200/0x3e099f5ef04aec8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d355 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.892564:0:12529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff8df2502f3700) 00010000:00010000:0.0:1789760798.892580:0:12529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df240031000/0x3e099f5ef04af2b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d386 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.892589:0:12529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff8df250325b00) 00010000:00010000:0.0:1789760798.892593:0:12529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760798.892611:0:12529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c200/0x3e099f5ef04af2e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.892625:0:12529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c200/0x3e099f5ef04af2e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.892634:0:12529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c200/0x3e099f5ef04af2e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.892662:0:12529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2d400/0x3e099f5ef04af2e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.892669:0:12529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2d400/0x3e099f5ef04af2e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.892676:0:12529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2d400/0x3e099f5ef04af2e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.893172:0:12529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c800/0x3e099f5ef04af2ee lrc: 3/0,1 mode: --/EX res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.893182:0:12529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c800/0x3e099f5ef04af2ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x15:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.893188:0:12529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c800/0x3e099f5ef04af2ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x15:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789760798.894235:0:12529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8640 00000004:00080000:0.0:1789760798.894246:0:12529:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 403007443033ns, next at 404007440928ns, rc = 0 00010000:00010000:0.0:1789760798.894298:0:12529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c600/0x3e099f5ef04af2f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.894309:0:12529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c600/0x3e099f5ef04af2f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.894318:0:12529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c600/0x3e099f5ef04af2f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.894325:0:12529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c600/0x3e099f5ef04af2f5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.894342:0:12529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c600/0x3e099f5ef04af2f5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.894347:0:12529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c600/0x3e099f5ef04af2f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.894420:0:12529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789760798.894440:0:12529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c800/0x3e099f5ef04af2ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.894447:0:12529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c800/0x3e099f5ef04af2ee lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.894453:0:12529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c800/0x3e099f5ef04af2ee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.894458:0:12529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df245d2c800 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760798.894463:0:12529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c800/0x3e099f5ef04af2ee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.894470:0:12529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c800/0x3e099f5ef04af2ee lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.894481:0:12529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff8df2502f3d00) 00010000:00010000:0.0:1789760798.894483:0:12529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789760798.894487:0:12529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c800/0x3e099f5ef04af2ee lrc: 2/0,0 mode: --/EX res: [0x200000401:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.894493:0:12529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c800/0x3e099f5ef04af2ee lrc: 0/0,0 mode: --/EX res: [0x200000401:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.894519:0:12529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c200/0x3e099f5ef04af2e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.894526:0:12529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c200/0x3e099f5ef04af2e0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.894531:0:12529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c200/0x3e099f5ef04af2e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.894534:0:12529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df245d2c200 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760798.894536:0:12529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c200/0x3e099f5ef04af2e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.894540:0:12529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c200/0x3e099f5ef04af2e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.894546:0:12529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff8df250325b00) 00010000:00010000:0.0:1789760798.894548:0:12529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760798.894551:0:12529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c200/0x3e099f5ef04af2e0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.894557:0:12529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c200/0x3e099f5ef04af2e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789760798.894566:0:12529:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000775e7c08 reply state 0000000041297d48 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2d400/0x3e099f5ef04af2e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760798.894574:0:12529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789760798.894655:0:12529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1da0113a-370d-4d79-883c-54efc174697f+14:11165:x1876699863195648:12345-192.168.203.12@tcp:36:rm.0 Request processed in 2203us (2441us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1789760798.894664:0:12529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 149 00010000:00010000:1.0:1789760798.894720:0:7646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789760798.894727:0:7646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c600/0x3e099f5ef04af2f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760798.894733:0:7646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df245d2c600 already unused, calling callback (ffffffffc15cb350) 00010000:00010000:1.0:1789760798.894736:0:7646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c600/0x3e099f5ef04af2f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760798.894743:0:7646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c600/0x3e099f5ef04af2f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760798.894758:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff8df2502f3d00) 00010000:00010000:1.0:1789760798.894761:0:7646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789760798.894765:0:7646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c600/0x3e099f5ef04af2f5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760798.894772:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c600/0x3e099f5ef04af2f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760798.894788:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760798.894791:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760798.894793:0:7646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760798.896025:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2d400/0x3e099f5ef04af2e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760798.896045:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2d400/0x3e099f5ef04af2e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760798.896052:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2d400/0x3e099f5ef04af2e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760798.896058:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df245d2d400 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:1.0:1789760798.896062:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2d400/0x3e099f5ef04af2e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760798.896068:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2d400/0x3e099f5ef04af2e7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760798.896080:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x4009f790 (ffff8df2502f3200) 00010000:00010000:1.0:1789760798.896083:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789760798.896087:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2d400/0x3e099f5ef04af2e7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760798.896100:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2d400/0x3e099f5ef04af2e7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x4009f790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760798.898252:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760798.898405:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863195904 00000100:00100000:0.0:1789760798.898414:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863195904 00000100:00100000:0.0:1789760798.898467:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:0.0:1789760798.898476:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df243ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+13:11165:x1876699863195904:12345-192.168.203.12@tcp:35:rm.0 00000100:00100000:0.0:1789760798.899957:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df243ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1da0113a-370d-4d79-883c-54efc174697f+14:11165:x1876699863195904:12345-192.168.203.12@tcp:35:rm.0 Request processed in 1474us (1703us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1789760798.899969:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:2.0:1789760798.905046:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1789760798.905140:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699863196160 00000100:00100000:0.0:1789760798.905150:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699863196160 00000100:00100000:0.0:1789760798.905205:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 150 00000100:00100000:0.0:1789760798.905216:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df26d660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+14:11165:x1876699863196160:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:0.0:1789760798.905282:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789760798.905306:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2d800/0x3e099f5ef04af2d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x13:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d394 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.905328:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2517f2600/0x3e099f5ef04aec5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d347 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.905343:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff8df250325b00) 00010000:00010000:0.0:1789760798.905361:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df2687c4e00/0x3e099f5ef04aebfc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xb91f8c745ab2d332 expref: 12 pid: 7279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.905371:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df245dcc900) 00010000:00010000:0.0:1789760798.905377:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789760798.905396:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c200/0x3e099f5ef04af2fc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.905418:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c200/0x3e099f5ef04af2fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.905425:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c200/0x3e099f5ef04af2fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.905434:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c800/0x3e099f5ef04af303 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.905438:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c800/0x3e099f5ef04af303 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.905444:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c800/0x3e099f5ef04af303 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.905742:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2ca00/0x3e099f5ef04af30a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.905751:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2ca00/0x3e099f5ef04af30a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.905758:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2ca00/0x3e099f5ef04af30a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789760798.906346:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 16384 00010000:00010000:0.0:1789760798.906362:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2ca00/0x3e099f5ef04af30a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.906370:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2ca00/0x3e099f5ef04af30a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.906376:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2ca00/0x3e099f5ef04af30a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.906388:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df245d2ca00 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760798.906392:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2ca00/0x3e099f5ef04af30a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.906400:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2ca00/0x3e099f5ef04af30a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.906411:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff8df2502f3b00) 00010000:00010000:0.0:1789760798.906414:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789760798.906418:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2ca00/0x3e099f5ef04af30a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.906424:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2ca00/0x3e099f5ef04af30a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.906441:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c200/0x3e099f5ef04af2fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.906448:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c200/0x3e099f5ef04af2fc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.906454:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c200/0x3e099f5ef04af2fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.906458:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df245d2c200 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:0.0:1789760798.906461:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c200/0x3e099f5ef04af2fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.906467:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c200/0x3e099f5ef04af2fc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.906487:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df2502f3700) 00010000:00010000:0.0:1789760798.906489:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789760798.906492:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c200/0x3e099f5ef04af2fc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.906497:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c200/0x3e099f5ef04af2fc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789760798.906509:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000544294ac reply state 0000000014853bdb transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c800/0x3e099f5ef04af303 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760798.906516:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789760798.906578:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df26d660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1da0113a-370d-4d79-883c-54efc174697f+13:11165:x1876699863196160:12345-192.168.203.12@tcp:36:rm.0 Request processed in 1363us (1598us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1789760798.906586:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 150 00010000:00010000:3.0:1789760798.911177:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c800/0x3e099f5ef04af303 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.911195:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c800/0x3e099f5ef04af303 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.911202:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c800/0x3e099f5ef04af303 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.911209:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df245d2c800 already unused, calling callback (ffffffffc200b4f0) 00010000:00010000:3.0:1789760798.911214:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c800/0x3e099f5ef04af303 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.911221:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c800/0x3e099f5ef04af303 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.911237:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28182c63 (ffff8df2502f3000) 00010000:00010000:3.0:1789760798.911240:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789760798.911258:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c800/0x3e099f5ef04af303 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760798.911264:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df245d2c800/0x3e099f5ef04af303 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28182c63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760798.927281:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760799.957253:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789760800.289074:0:12636:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 404402269518ns, next at 404007440928ns, rc = 0 Debug log: 29717 lines, 29717 kept, 0 dropped, 0 bad.